-- Logs begin at Wed 2022-11-02 19:51:32 UTC, end at Wed 2022-11-02 20:57:43 UTC. -- Nov 02 20:21:41.721245 dv-cinder-862365-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 20:21:41.730702 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 20:21:41 2022] *** Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: nodename: dv-cinder-862365-5-iscsi Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: machine: x86_64 Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: clock source: unix Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: pcre jit disabled Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: detected number of CPU cores: 4 Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: current working directory: / Nov 02 20:21:41.732733 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: detected binary path: /usr/bin/uwsgi-core Nov 02 20:21:41.733968 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: your processes number limit is 47680 Nov 02 20:21:41.733968 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: your memory page size is 4096 bytes Nov 02 20:21:41.733968 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: detected max file descriptor number: 2048 Nov 02 20:21:41.733968 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: lock engine: pthread robust mutexes Nov 02 20:21:41.733968 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: thunder lock: enabled Nov 02 20:21:41.733968 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 20:21:41.733968 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 20:21:41.773691 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: Python main interpreter initialized at 0x563c24c6c9c0 Nov 02 20:21:41.773691 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: python threads support enabled Nov 02 20:21:41.773691 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: your server socket listen backlog is limited to 100 connections Nov 02 20:21:41.773691 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: your mercy for graceful operations on workers is 90 seconds Nov 02 20:21:41.774209 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 20:21:41.774366 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: *** Operational MODE: preforking *** Nov 02 20:21:41.774652 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: *** uWSGI is running in multiple interpreter mode *** Nov 02 20:21:41.774652 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: spawned uWSGI master process (pid: 103721) Nov 02 20:21:41.774861 dv-cinder-862365-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 20:21:41.775432 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: spawned uWSGI worker 1 (pid: 103722, cores: 1) Nov 02 20:21:41.775783 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: spawned uWSGI worker 2 (pid: 103723, cores: 1) Nov 02 20:21:41.775976 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 20:21:42.441280 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 20:21:42.441885 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 20:21:43.515330 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:21:43.515330 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: from cryptography.utils import int_from_bytes Nov 02 20:21:43.516078 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:21:43.516078 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: from cryptography.utils import int_from_bytes Nov 02 20:21:43.516229 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:21:43.516229 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: from cryptography.utils import int_from_bytes Nov 02 20:21:43.516229 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:21:43.516229 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: from cryptography.utils import int_from_bytes Nov 02 20:21:46.020593 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 20:21:46.021289 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 20:21:46.021689 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 20:21:46.021822 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 20:21:46.021960 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 20:21:46.022104 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 20:21:46.022243 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 20:21:46.022380 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 20:21:46.022506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 20:21:46.022630 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 20:21:46.022761 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.022881 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023023 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023265 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023393 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023515 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023695 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023837 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.023967 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.024088 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.024226 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.024401 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.024536 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.024658 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.024790 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.024912 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.025034 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.025309 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.025446 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.025568 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.025693 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.025816 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-5-iscsi {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.025941 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-5-iscsi {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.026083 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.026212 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.026334 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.026464 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.026632 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.026813 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.026952 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.027075 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.027208 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.027341 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.027470 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.027594 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.027785 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.027916 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.028113 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.028309 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.028509 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.028687 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.028863 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.029028 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.029185 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.029346 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.029346 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.029664 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.029831 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.030004 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.030872 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.031076 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.031076 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.031462 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.031625 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.031766 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.031901 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.032035 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.032186 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.032333 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.032535 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-5-iscsi {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.032728 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-5-iscsi {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.032900 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.033024 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.033211 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.033380 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.033516 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.033691 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.033860 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.034011 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.034159 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.034306 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.034509 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.034687 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.034823 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.034974 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.035121 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.035253 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.035448 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.035580 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.035775 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.035913 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.036042 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.036174 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.036294 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.036420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.036553 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.036690 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.036829 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037021 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037143 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037266 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037529 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037652 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037776 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.037897 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038017 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038149 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038286 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038409 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038530 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038662 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038832 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.038964 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.039086 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.039206 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.039337 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.039458 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.039593 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.039772 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.039912 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040036 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040293 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040434 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040556 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040678 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040678 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.040913 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.041045 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.041165 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.041285 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.041470 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.041652 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.041777 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.041916 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042037 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042170 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042299 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042422 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042548 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042681 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042801 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.042931 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.043064 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.043188 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.043320 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.043485 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.043645 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.043812 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.043950 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.044128 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.044264 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.044517 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.044655 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.044827 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.044948 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.045076 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.045211 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.045377 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.045508 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.045687 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.045819 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.046011 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.046144 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.046395 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.046525 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.046714 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.046849 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.047025 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.047199 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.047322 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.047444 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.047631 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.047760 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.047946 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.048084 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.048272 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.048393 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.048568 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.048690 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.048831 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.048953 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.049100 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.049222 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.049397 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.049519 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.049706 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.049826 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050004 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050126 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050303 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050499 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050622 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050743 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050863 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.050998 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.051161 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.051295 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.051460 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.051673 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.051843 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.051964 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.052087 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.052225 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.052415 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.052576 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.052696 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.052818 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.052953 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.053085 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.053206 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.053339 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.053497 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.053621 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.053793 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.053927 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.054100 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.054234 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.054410 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.054533 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.054707 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.054833 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.055257 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.055408 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.055556 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.055717 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.055870 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.056009 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.056183 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.056307 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.056481 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.056604 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.056776 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.056911 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.057087 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.057264 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.057389 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.057509 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.057668 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.057807 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.057977 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.058100 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.058276 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.058398 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.058571 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.058704 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.058879 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.059003 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.059171 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.059293 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.059467 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.059589 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.059780 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.059918 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.060081 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.060208 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.060379 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.060502 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.060674 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.060811 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.060966 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.061088 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.061262 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.061539 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.061681 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.061816 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.061992 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.062126 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.062251 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.062376 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.062501 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.062625 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.062756 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.062892 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.063039 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.063176 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.063341 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.063485 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.063655 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.063796 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.063955 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.064082 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.064267 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.064392 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:21:46.064596 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.064733 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.064927 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.065085 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.065260 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.065385 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.065568 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.065694 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.065893 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.066027 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.066213 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.066347 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.066525 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.066650 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.066830 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.066952 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.067133 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.067256 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.067438 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.067559 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.067768 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.067894 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.068075 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.068214 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.068377 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.068501 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.068687 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.068839 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.068998 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.069122 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.069321 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.069458 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.069632 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.069768 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.069942 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.070078 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.070253 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.070379 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.070558 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.070683 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.070868 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.071075 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.071198 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.071326 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.071491 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.071692 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.071820 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.071960 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.072143 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.072278 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.072474 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.072598 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.072784 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.072923 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.073105 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.073230 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.073421 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.073547 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.073729 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.073865 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.074036 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.074162 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.074344 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.074470 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.074682 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.074806 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.074989 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.075166 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.075289 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.075415 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.075594 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.075751 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.075921 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.076048 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.076235 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.076361 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.076541 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.076666 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.076844 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.077534 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.077691 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.077932 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.078071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.078246 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.078373 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.078554 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.078712 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.078875 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.079000 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.079183 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.079318 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.079491 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.079680 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.079823 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.079948 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.080118 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.080242 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.080423 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.080556 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.080726 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.080860 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.081031 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.081168 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.081330 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.081452 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.081627 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.081760 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.081931 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.082063 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.082226 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.082414 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.082536 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.082662 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.082811 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.082934 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.083129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.083266 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.083431 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.083565 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.083760 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.083887 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.084083 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.084250 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.084377 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.084503 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.084673 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.084800 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.084978 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.085116 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.085293 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.085425 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.085552 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.085677 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.085856 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.085981 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.086154 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.086278 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.086448 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.086584 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.086765 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.086891 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.087064 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.087187 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.087359 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.087484 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.087698 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.087838 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.087993 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.088116 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.088291 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.088416 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.088597 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.088721 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.088899 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.089023 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.089202 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.089345 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.089507 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.089633 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.089810 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.089933 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.090117 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.090259 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.090419 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.090542 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.090723 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.090846 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.091049 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.091186 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.091348 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.091481 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.091685 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.091802 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.092015 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.092121 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.092329 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.092428 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.092643 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.093257 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.093531 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.093664 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.093819 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.093935 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.094119 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.094208 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.094418 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.094507 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.094717 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.094805 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.095019 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.095106 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.095316 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.095406 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.095648 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.095740 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.095938 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.096025 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.096236 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.096326 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.096535 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.096624 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.096850 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.096952 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.097149 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.097235 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.097443 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.097528 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.097742 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.097881 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.098036 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.098122 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.098367 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.098454 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.098666 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.098762 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.099001 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.099097 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.099318 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.099405 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.099640 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.099792 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.099964 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.100082 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.100269 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.100397 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.100582 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.100708 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.100887 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.101019 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.101192 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.101329 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.101497 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.101637 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.101801 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.101956 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.102115 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.102265 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.102419 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.102582 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.102732 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.102893 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.103038 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.103212 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.103359 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.103521 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.103692 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.103862 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.104007 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.104166 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.104304 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.104481 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.104612 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.104814 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.104942 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.105145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.105269 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.105460 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.105580 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.105777 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.105910 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.106086 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.106175 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.106403 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.106490 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.106710 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.106796 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.107016 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.107104 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.107324 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.107411 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.107656 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.107747 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.107968 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.108055 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.108298 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.108454 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.108615 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.108776 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.108925 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.109083 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.109243 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.109399 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.109553 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.109707 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.109869 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.110019 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.110172 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.110319 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.110485 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.110628 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.110810 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.110949 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.111137 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.111273 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.111443 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.111577 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.111877 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.111968 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.112202 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.112301 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.112505 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.112600 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.112811 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.112898 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.113116 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.113204 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.113417 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.113514 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.113714 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.113800 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.114016 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.114103 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.114324 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.114412 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.114627 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.114714 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.114929 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.115015 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.115228 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.115317 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.115534 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.115644 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.115860 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.115994 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.116160 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.116262 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.116457 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.116544 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.116762 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.116856 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.117074 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.117161 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.117378 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.117463 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.117691 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.117785 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118004 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118089 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118299 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118386 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118595 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118692 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118908 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.118996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.119211 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.119296 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.119504 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.119603 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.119824 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.119912 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.120120 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.120220 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.120456 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.120551 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.120760 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.120846 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.121060 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.121145 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.121369 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.121456 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.121684 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.121777 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.121985 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.122072 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.122293 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.122380 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.122714 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.122825 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.122957 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.123045 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.123203 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.123290 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.123507 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.123593 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.123835 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.123937 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.124267 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.124450 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.124574 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.124757 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.124882 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.125064 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.125191 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.125370 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.125510 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.125687 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.125816 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.125993 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.126123 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.126296 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.126435 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.126602 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.126735 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.126898 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.127042 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.127201 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.127354 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.127511 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.127949 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.128132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.128276 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.128416 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.128587 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.128723 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.128902 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.129034 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.129240 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.129405 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.129557 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.129655 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.129883 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.129970 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.130206 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.130306 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.130517 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.130605 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.130820 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.130987 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.131125 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.131215 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.131429 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.131516 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.131748 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.131843 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.132055 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.132145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.132354 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.132441 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.132651 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.132798 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.132960 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.133059 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.133247 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.133341 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.133546 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.133633 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.133842 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.133929 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.134139 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.134226 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.134437 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.134533 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.134743 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.134829 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.135038 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.135123 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.135341 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.135437 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.135656 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.135747 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.135978 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.136291 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.136593 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.136744 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.136893 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.137072 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.137193 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.137378 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.137529 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.137680 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.137832 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.137982 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.138167 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.138323 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.138492 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.138629 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.138830 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.138962 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.139134 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.139284 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.139437 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.140218 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.140309 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.140525 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.140611 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.140828 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.140927 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.141147 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.141236 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.141447 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.141542 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.141746 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.141847 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.142044 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.142131 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.142346 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.142433 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.142649 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.142743 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.142945 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.143047 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.143249 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.143346 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.143545 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.143654 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.143872 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.143958 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.144172 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.144267 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.144473 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.144559 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.144774 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.144860 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.145070 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.145159 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.145365 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.145451 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.145667 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.145752 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.145964 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.146063 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.146260 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.146346 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.146560 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.146646 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.146861 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.146956 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.147157 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.147249 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.147458 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.147543 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.147772 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.147873 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.148070 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.148155 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.148365 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.148450 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.148663 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.148759 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.148958 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.149044 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.149260 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.149347 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.149564 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.149652 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.149861 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.149946 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.150161 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.150247 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.150461 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.150549 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.150759 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.150844 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.151053 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.151138 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.151355 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.151444 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.151670 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.151762 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.151969 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.152056 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.152272 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.152406 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.152582 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.152669 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.152882 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.153021 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.153177 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.153278 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.153478 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.153584 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.153771 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.153932 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.154067 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.154154 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.154363 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.154448 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.154662 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.154762 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.154954 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.155039 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.155814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.155913 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.156116 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.156221 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.156414 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.156539 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.156710 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.156852 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.157024 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.157158 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.157326 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.157463 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.157621 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.157803 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.157919 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.158109 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.158215 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.158465 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.158552 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.158772 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.158868 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.159084 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.159170 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.159400 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.159486 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.159733 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.159837 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.160045 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.160140 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.160354 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.160449 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.160656 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.160751 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.160959 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.161052 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.161258 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.161358 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.161564 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.161664 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.161865 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.161952 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.162162 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.162247 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.162456 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.162550 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.162753 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.162848 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.163065 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.163152 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.163368 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.163473 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.163698 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.163803 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.164018 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.164321 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.164631 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.164940 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.165026 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.165247 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.165333 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.165555 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.165644 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.165862 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.165949 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.166167 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.166297 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.166473 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.166568 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.166787 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.166874 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.167094 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.167181 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.167398 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.167486 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.167724 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.167814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.168032 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.168119 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.168337 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.168426 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.168636 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.168724 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.168939 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.169033 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.169245 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.169332 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.169542 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.169635 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.169845 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.169939 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.170142 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.170227 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.170447 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.170534 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.170852 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.170953 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.171340 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.171560 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.171734 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.171974 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.172062 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.172303 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.172391 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.172613 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.172700 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.172923 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.173018 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.173235 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.173415 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.173550 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.173835 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.173925 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.174170 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.174258 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.174493 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.174582 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.174819 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.174914 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.175131 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.175218 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.175432 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.175519 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.175757 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.175849 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.176065 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.176153 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.176384 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.176512 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.176685 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.176831 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.176992 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.177148 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.177292 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.177466 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.177608 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.177776 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.177908 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.178084 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.178224 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.178401 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.178634 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.178734 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.178941 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.179028 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.179240 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.179326 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.179645 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.179748 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.179962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.180314 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.180535 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.180622 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.180850 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.180937 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.181166 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.181254 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.181485 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.181571 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.181786 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.181883 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.182093 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.182266 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.182399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.182579 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.182714 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.182893 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.183029 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.183215 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.183334 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.183537 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.183663 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.183888 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.183992 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.184196 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.184286 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.184510 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.184601 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.184822 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.184920 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.185145 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.185233 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.185469 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.185556 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.185780 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.185876 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.186095 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.186182 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.186470 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.186569 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.186962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.187052 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.187466 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.187562 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.187802 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.187893 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.188115 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.188205 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.188419 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.188531 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.188721 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.188858 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.189041 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.189172 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.189344 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.189499 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.189651 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.189826 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.189958 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.190134 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.190263 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.190439 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.190560 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.190753 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.190861 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.191065 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.191179 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.191370 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.191481 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.191716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.191828 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.192024 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.192139 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.192337 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.192458 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.192651 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.192777 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.192962 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.193079 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.193269 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.193417 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.193578 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.193674 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.193900 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.193988 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.194204 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.194300 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.194527 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.194615 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.194841 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.194929 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.195158 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.195288 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.195477 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.195570 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.195806 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.195894 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.196127 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.196229 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.196433 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.196519 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.196735 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.196821 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.197040 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.197129 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.197343 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.197437 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.197666 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.197751 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.197981 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.198068 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.198298 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.198383 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.198600 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.198688 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.198899 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.198987 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.199204 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.199293 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.199503 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.199599 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.199830 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.199926 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.200130 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.200218 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.200433 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.200529 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.200733 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.200827 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.201033 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.201130 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.201332 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.201428 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.201650 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.201738 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.201952 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.202615 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.203043 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.203298 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.203568 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.203727 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.203965 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.204059 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.204275 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.204365 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.204579 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.204666 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.204922 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.205009 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.205228 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.205324 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.205553 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.205639 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.205862 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.205958 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.206181 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.206276 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.206490 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.206576 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.206797 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.206884 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.207104 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.207196 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.207408 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.207497 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.207748 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.207852 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.208065 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.208162 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.208376 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.208472 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.208682 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.208783 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.208996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.209084 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.209309 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.209396 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.209623 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.209718 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.209941 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.210141 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.210260 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.210468 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.210578 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.210781 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.210895 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.211091 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.211217 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.211401 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.211528 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.211735 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.211871 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.212047 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.212188 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.212354 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.212509 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.212663 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.212972 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.213059 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.213279 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.213376 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.213602 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.213735 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.213919 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.214008 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.214238 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.214327 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.214558 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.214645 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.214869 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.214955 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.215178 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.215274 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.215485 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.215573 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.215820 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.215919 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.216135 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.216237 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.216465 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.216561 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.216766 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.216852 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.217076 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.217164 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.217386 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.217474 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.218343 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.218794 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.218905 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.219067 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.219171 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.219383 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.219479 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.219723 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.219829 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.220037 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.220166 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.220346 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.220487 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.220658 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.220799 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.220970 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.221116 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.221291 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.221434 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.221623 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.221750 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.221943 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.222067 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.222253 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.222380 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.222563 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.222695 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.222876 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.223009 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.223321 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.223421 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.223650 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.223788 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.223968 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.224055 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.224281 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.224380 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.224604 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.224705 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.224937 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.225025 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.225249 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.225337 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.225560 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.225653 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.225862 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.225949 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.226164 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.226253 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.226471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.226678 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.226765 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.226992 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.227092 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.227326 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.227429 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.227673 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.227765 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.227980 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.228079 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.228297 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.228395 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.228601 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.228697 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.228924 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.229127 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.229216 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.229471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.229567 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.229782 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.229879 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.230103 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.230191 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.230406 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.230492 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.230722 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.230816 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.231025 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.231127 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.231326 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.231646 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.231747 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.231953 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.232049 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.232267 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.232487 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.232583 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.232834 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.232922 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.233143 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.233261 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.233474 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.233778 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.233993 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.234088 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.234333 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.234421 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.234653 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.234748 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.234964 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.235050 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.235266 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.235361 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.235567 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.235690 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.235897 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.235987 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.236205 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.236300 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.236507 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.236603 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.236809 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.236935 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.237111 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.237197 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.237409 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.237500 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.237722 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.237822 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.238024 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.238111 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.238331 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.238420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.238632 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.238720 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.238939 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.239029 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.239248 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.239336 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.239556 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.239689 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.239888 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.239996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.240201 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.240290 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.240501 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.240588 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.240802 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.240965 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.241107 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.241247 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.241412 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.241507 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.241727 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.241822 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.242029 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.242122 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.242335 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.242422 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.242637 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.242737 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.242947 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.243042 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.243296 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.243483 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.243607 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.243839 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.243964 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.244157 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.244245 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.244484 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.244585 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.244812 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.244902 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.245114 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.245202 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.245417 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.245514 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.245722 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.245810 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.246032 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.246118 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.246338 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.246438 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.246648 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.246737 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.246956 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.247044 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.247264 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.247501 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.247589 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.247864 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.247956 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.248187 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.248286 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.248492 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.248589 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.248798 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.249401 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.249628 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.249937 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.250097 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.250244 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.250420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.250551 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.250737 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.250856 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.251072 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.251161 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.251391 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.251479 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.251736 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.251830 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.252055 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.252143 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.252377 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.252474 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.252690 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.252779 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.253000 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.253086 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.253307 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.253393 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.253613 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.253708 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.253918 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.254001 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.254227 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.254321 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.254539 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.254627 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.254845 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.254937 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.255144 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.255241 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.255453 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.255797 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.255887 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.256137 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.256225 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.256457 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.256547 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.256775 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.256863 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.257085 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.257180 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.257398 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.257530 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.257710 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.257805 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.258017 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.258112 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.258328 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.258415 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.258635 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.258722 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.258947 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.259046 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.259276 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.259364 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.259587 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.259733 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.259920 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.260011 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.260222 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.260528 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.260614 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.260832 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.260930 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.261139 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.261228 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.261455 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.261547 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.261762 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.261858 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.262065 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.262152 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.262366 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.262453 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.262673 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.262761 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.262973 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.263067 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.263276 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.263363 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.263579 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.263717 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.263904 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.263992 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.264210 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.264296 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.264529 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.265279 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.265412 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.265718 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.265999 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.266087 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.266371 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.266492 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.266605 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.266700 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.266889 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.266986 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.267190 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.267286 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.267491 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.267576 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.267816 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.267919 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.268122 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.268211 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.268420 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.268509 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.268740 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.268834 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.269048 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.269136 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.269354 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.269441 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.269659 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.269755 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.269964 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.270050 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.270265 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.270358 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.270571 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.270702 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.270874 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.270963 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.271178 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.271265 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.271481 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.271572 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.271807 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.271897 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.272115 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.272201 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.272423 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.272513 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.272727 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.272814 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.273030 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.273118 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.273334 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.273423 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.273636 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.273724 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.273940 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.274035 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.274263 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.274358 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.274584 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.274672 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.274887 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.274987 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.275206 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.275294 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.275520 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.275624 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.275860 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.275959 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.276174 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.276270 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.276480 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.276570 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.276803 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.276893 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.277108 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.277244 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.277414 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.277502 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.277720 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.277809 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.278030 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.278125 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.278338 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.278426 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.278646 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.278733 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.278949 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.279035 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.279255 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.279351 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.279566 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.279699 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.279903 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.279991 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.280249 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.280627 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.280721 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.281041 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.281135 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.281363 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.281459 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.281685 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.281772 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.282000 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.282093 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.282312 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.282409 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.282647 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.282742 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.282958 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.283046 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.283265 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.283361 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.283575 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.283714 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.283903 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.283991 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.284145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 20:21:46.284246 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.284515 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.284825 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.285135 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.285451 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.285766 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.286093 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.286418 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.286729 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.287055 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.287381 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.287760 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.288074 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.288416 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.288743 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.289056 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.289367 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.289669 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:21:46.289913 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 20:21:46.438703 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO dbcounter [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Registered counter for database nova_api Nov 02 20:21:46.449155 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Registered counter for database nova_api Nov 02 20:21:46.461193 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_db.sqlalchemy.engines [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.468699 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writer thread running {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:46.470200 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.476935 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:46.527568 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.context [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1c810e1-7ff3-414d-8672-1a44e300f691(cell1) {{(pid=103723) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 20:21:46.532043 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_concurrency.lockutils [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:21:46.532515 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_concurrency.lockutils [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:21:46.534158 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_concurrency.lockutils [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:21:46.534880 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_concurrency.lockutils [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:21:46.535323 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_concurrency.lockutils [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:21:46.535877 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.context [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1c810e1-7ff3-414d-8672-1a44e300f691(cell1) {{(pid=103722) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 20:21:46.537346 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_concurrency.lockutils [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:21:46.539361 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO dbcounter [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Registered counter for database nova_cell0 Nov 02 20:21:46.539765 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:21:46.540235 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:21:46.542004 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:21:46.542595 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:21:46.543037 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:21:46.543410 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO dbcounter [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Registered counter for database nova_cell1 Nov 02 20:21:46.545049 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:21:46.547838 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Registered counter for database nova_cell0 Nov 02 20:21:46.551881 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_db.sqlalchemy.engines [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.552069 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Registered counter for database nova_cell1 Nov 02 20:21:46.553690 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_db.sqlalchemy.engines [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.559385 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.559674 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writer thread running {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:46.563128 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.563251 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writer thread running {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:46.565140 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:46.705889 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:46.714139 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO dbcounter [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Registered counter for database nova_cell0 Nov 02 20:21:46.714688 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Registered counter for database nova_cell0 Nov 02 20:21:46.723725 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG oslo_db.sqlalchemy.engines [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.727537 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:21:46.728701 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writer thread running {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:46.732368 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:21:47.068670 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:21:47.075866 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:21:47.079955 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: WARNING keystonemiddleware.auth_token [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:21:47.087253 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: WARNING keystonemiddleware.auth_token [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:21:47.421526 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:21:47.427444 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:21:47.432988 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c24c6c9c0 pid: 103722 (default app) Nov 02 20:21:47.435193 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:21:47.436670 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001946 Nov 02 20:21:47.437084 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Nov 2 20:21:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:21:47.444854 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: WARNING keystonemiddleware.auth_token [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:21:47.450846 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: WARNING keystonemiddleware.auth_token [None req-eabe895f-e97b-460b-b6b8-835a2265c700 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:21:47.457208 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c24c6c9c0 pid: 103723 (default app) Nov 02 20:23:08.649173 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:08.650877 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Nov 02 20:23:08.651707 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:08.668676 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_api:SELECT=3 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:08.670462 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_cell0:SELECT=3 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:08.671285 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_cell1:SELECT=3 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:08.672346 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:09.543025 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-8a1729ee-e8ba-4aec-a480-d67840c2ecb4 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:09.578492 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-8a1729ee-e8ba-4aec-a480-d67840c2ecb4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920066 Nov 02 20:23:09.579414 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 20:23:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:12.223790 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:12.224805 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-601b0f2a-f8c7-4c1a-a878-ac187f4ce14f None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Nov 02 20:23:12.227965 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:12.669805 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-018ef93a-6b11-4740-847a-1e39c688d9f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:12.717513 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-018ef93a-6b11-4740-847a-1e39c688d9f6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486247 Nov 02 20:23:12.718296 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 20:23:12.936184 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-2d4b8087-f009-4a17-926f-c126a0cfa4d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:12.942584 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:12.943666 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:12.944442 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell1:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:12.945158 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:13.009199 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-2d4b8087-f009-4a17-926f-c126a0cfa4d4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282667 Nov 02 20:23:13.009786 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 20:23:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:15.623410 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-018ef93a-6b11-4740-847a-1e39c688d9f6 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:15.624536 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-018ef93a-6b11-4740-847a-1e39c688d9f6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Nov 02 20:23:15.625023 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:16.270728 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-84c3ad9b-fc35-49fd-b25a-7a13ecd98ac8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:16.316736 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-84c3ad9b-fc35-49fd-b25a-7a13ecd98ac8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684885 Nov 02 20:23:16.319661 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:16.331096 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-7a68cf3d-d00e-4374-91b7-ab73a28ee14c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:16.375357 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-7a68cf3d-d00e-4374-91b7-ab73a28ee14c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048203 Nov 02 20:23:16.376262 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 20:23:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:23:19.027594 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-84c3ad9b-fc35-49fd-b25a-7a13ecd98ac8 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:19.029937 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-84c3ad9b-fc35-49fd-b25a-7a13ecd98ac8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002776 Nov 02 20:23:19.030356 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:19.454396 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-e7c823a9-ed0a-4e11-a99c-0c42e6875667 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "vcpus": 1}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:19.479235 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-e7c823a9-ed0a-4e11-a99c-0c42e6875667 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441914 Nov 02 20:23:19.479843 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:19.492581 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-aeb009ef-a4b2-4f17-b16f-85759c2e70df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:19.524326 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-aeb009ef-a4b2-4f17-b16f-85759c2e70df admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035522 Nov 02 20:23:19.524896 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 20:23:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:22.166331 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-e7c823a9-ed0a-4e11-a99c-0c42e6875667 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:22.167347 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-e7c823a9-ed0a-4e11-a99c-0c42e6875667 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 02 20:23:22.167978 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:22.597518 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-7efbdda3-2665-44d7-a133-6beffc5cad53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "name": "ds2G", "disk": 10, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:22.617461 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-7efbdda3-2665-44d7-a133-6beffc5cad53 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442429 Nov 02 20:23:22.618097 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:22.631700 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-f4601041-2550-407b-b7f8-1c65e06bb616 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:22.659912 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-f4601041-2550-407b-b7f8-1c65e06bb616 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032355 Nov 02 20:23:22.660649 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 20:23:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:25.298428 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-7efbdda3-2665-44d7-a133-6beffc5cad53 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:25.299915 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-7efbdda3-2665-44d7-a133-6beffc5cad53 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002235 Nov 02 20:23:25.300407 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:25.719771 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-ead15f9a-f19b-433b-a901-123e62b46386 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "ram": 4096, "id": "d4"}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:25.741704 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-ead15f9a-f19b-433b-a901-123e62b46386 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433335 Nov 02 20:23:25.742258 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 20:23:25.759475 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4856f127-bb80-40d0-b1b3-b19413f2dfa2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:25.790567 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4856f127-bb80-40d0-b1b3-b19413f2dfa2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036171 Nov 02 20:23:25.791306 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 20:23:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:28.374522 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-ead15f9a-f19b-433b-a901-123e62b46386 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:28.375543 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-ead15f9a-f19b-433b-a901-123e62b46386 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 02 20:23:28.375988 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:23:28.813217 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-aae829cf-5db0-4562-a0e0-c1b8ee72da5f admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:28.838497 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-aae829cf-5db0-4562-a0e0-c1b8ee72da5f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456126 Nov 02 20:23:28.838992 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 20:23:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:23:31.435426 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-ead15f9a-f19b-433b-a901-123e62b46386 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:31.436551 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-ead15f9a-f19b-433b-a901-123e62b46386 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 Nov 02 20:23:31.436953 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:31.839222 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-16739ce2-dc6f-4689-838a-e6a92505c2f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "id": "1"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:31.859141 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-16739ce2-dc6f-4689-838a-e6a92505c2f8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.416050 Nov 02 20:23:31.859720 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:31.872348 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-94810b54-410c-47ab-aaa9-acaee81f8b37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:31.899275 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-94810b54-410c-47ab-aaa9-acaee81f8b37 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031226 Nov 02 20:23:31.899980 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 20:23:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:23:34.511816 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-16739ce2-dc6f-4689-838a-e6a92505c2f8 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:34.513591 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-16739ce2-dc6f-4689-838a-e6a92505c2f8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Nov 02 20:23:34.514366 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:34.888116 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-c62cdcac-3071-49d8-8573-7c9726479329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:34.908193 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-c62cdcac-3071-49d8-8573-7c9726479329 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.387618 Nov 02 20:23:34.908740 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:34.921329 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-c4650c59-57c0-48ad-bf2e-4dce6937914f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:34.944780 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-c4650c59-57c0-48ad-bf2e-4dce6937914f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027792 Nov 02 20:23:34.945349 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 20:23:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:37.594551 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-c62cdcac-3071-49d8-8573-7c9726479329 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:37.596244 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-c62cdcac-3071-49d8-8573-7c9726479329 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002204 Nov 02 20:23:37.596647 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:38.042073 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-63d20da4-1e7e-4ba8-bbd2-6a8d5729e4d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "vcpus": 2, "ram": 4096, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:38.065937 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-63d20da4-1e7e-4ba8-bbd2-6a8d5729e4d8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.463164 Nov 02 20:23:38.066593 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:38.078664 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-15b60c29-8a2d-4e33-8dd5-8db77031b224 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:38.108208 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-15b60c29-8a2d-4e33-8dd5-8db77031b224 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033066 Nov 02 20:23:38.111924 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 20:23:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:40.821066 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-63d20da4-1e7e-4ba8-bbd2-6a8d5729e4d8 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:40.822082 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-63d20da4-1e7e-4ba8-bbd2-6a8d5729e4d8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 02 20:23:40.822656 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:41.316564 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-9be058d6-8f7f-49d0-a0ad-ffe9d905cac4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:41.323156 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:41.348081 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-9be058d6-8f7f-49d0-a0ad-ffe9d905cac4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.518044 Nov 02 20:23:41.349357 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:41.376129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-650426b2-2a7a-4c81-b78b-b1d823aa1d5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:41.409468 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-650426b2-2a7a-4c81-b78b-b1d823aa1d5e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039733 Nov 02 20:23:41.410523 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 20:23:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:23:44.163815 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-9be058d6-8f7f-49d0-a0ad-ffe9d905cac4 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:23:44.164837 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-9be058d6-8f7f-49d0-a0ad-ffe9d905cac4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Nov 02 20:23:44.165241 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:23:44.610778 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e2b6d8a8-84f4-4178-962d-464eea0b7ff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:44.618176 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:44.634232 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e2b6d8a8-84f4-4178-962d-464eea0b7ff1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462319 Nov 02 20:23:44.634975 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 20:23:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:23:44.647218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-f95ffb3a-fab0-4714-8695-53dca808319c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:23:44.673490 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-f95ffb3a-fab0-4714-8695-53dca808319c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029901 Nov 02 20:23:44.674232 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 20:23:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:24:01.495518 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e2b6d8a8-84f4-4178-962d-464eea0b7ff1 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:01.497160 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e2b6d8a8-84f4-4178-962d-464eea0b7ff1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Nov 02 20:24:01.497552 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:01.507975 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:01.888760 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-b791fbfc-4149-4aa3-a9af-4dbb6e6613dd admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:01.907198 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-b791fbfc-4149-4aa3-a9af-4dbb6e6613dd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403685 Nov 02 20:24:01.907754 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 20:24:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:24:03.203037 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e2b6d8a8-84f4-4178-962d-464eea0b7ff1 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:03.204165 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e2b6d8a8-84f4-4178-962d-464eea0b7ff1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Nov 02 20:24:03.204646 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:03.736826 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-6636f341-31bb-41ff-be2b-b808e69d6ab1 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:03.742208 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.wsgi [None req-6636f341-31bb-41ff-be2b-b808e69d6ab1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-6636f341-31bb-41ff-be2b-b808e69d6ab1 admin admin] Request method failure captured: Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Accept: application/json Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Accept-Encoding: gzip, deflate Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Connection: keep-alive Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Content-Length: 0 Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Host: 10.222.0.26 Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Openstack-Api-Version: compute 2.92 Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Openstack-System-Scope: None Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: User-Agent: python-novaclient Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Auth-Token: gAAAAABjYtHj6hyOSuwa3-TrQ02LWhfA78tHVHScdO5-N0Fg6GNBvseKYu0iGKnxim7gn3D1LHNZDXQZJtt6iULG3PBPcO6cy2zjnCSRgRgCp1eaxTereZMGLyjo6FYC0CCtVtRiSNn4VzAeB28LquD0p1Xtfa6QdkQLOMGsppdISI_7Q9UwGJ8 Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Domain-Id: None Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Domain-Name: None Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Identity-Status: Confirmed Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Is-Admin-Project: True Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Domain-Id: default Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Domain-Name: Default Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Name: admin Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Role: admin,reader,member Nov 02 20:24:03.745471 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Roles: admin,reader,member Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}] Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant: admin Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant-Name: admin Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User: admin Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Domain-Id: default Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Domain-Name: Default Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Id: edd73f18c8a4441794facbca0f30e7c6 Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Name: admin Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: method: > Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: exception: Flavor 42 could not be found. Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: action_args: {'id': '42'} Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:24:03.747145 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:03.752617 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.753996 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-6636f341-31bb-41ff-be2b-b808e69d6ab1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:24:03.755280 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-6636f341-31bb-41ff-be2b-b808e69d6ab1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394510 Nov 02 20:24:03.755280 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 20:24:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:03.756480 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-60dfd876-294b-4c3e-8163-9dd9c4c4d58d admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:03.779223 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-60dfd876-294b-4c3e-8163-9dd9c4c4d58d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026281 Nov 02 20:24:03.779774 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 20:24:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:24:03.790202 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-1adf0a66-f303-4bdf-aa62-c13e062c0b6a admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:03.812295 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-1adf0a66-f303-4bdf-aa62-c13e062c0b6a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026528 Nov 02 20:24:03.812830 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 20:24:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:24:03.822085 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-cbc2e426-4bbf-493c-9709-6c1d63d878a4 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:03.827516 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-cbc2e426-4bbf-493c-9709-6c1d63d878a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-cbc2e426-4bbf-493c-9709-6c1d63d878a4 admin admin] Request method failure captured: Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Accept: application/json Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Connection: keep-alive Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Content-Length: 0 Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Host: 10.222.0.26 Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.92 Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABjYtHj6hyOSuwa3-TrQ02LWhfA78tHVHScdO5-N0Fg6GNBvseKYu0iGKnxim7gn3D1LHNZDXQZJtt6iULG3PBPcO6cy2zjnCSRgRgCp1eaxTereZMGLyjo6FYC0CCtVtRiSNn4VzAeB28LquD0p1Xtfa6QdkQLOMGsppdISI_7Q9UwGJ8 Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Role: admin,reader,member Nov 02 20:24:03.830716 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Roles: admin,reader,member Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}] Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant: admin Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User: admin Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Id: edd73f18c8a4441794facbca0f30e7c6 Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Name: admin Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: method: > Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: exception: Flavor 42 could not be found. Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: action_args: {'id': '42'} Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:24:03.832234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:03.833159 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:03.834394 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-cbc2e426-4bbf-493c-9709-6c1d63d878a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:24:03.835714 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-cbc2e426-4bbf-493c-9709-6c1d63d878a4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013688 Nov 02 20:24:03.835714 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 20:24:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:05.031409 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-1adf0a66-f303-4bdf-aa62-c13e062c0b6a admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:05.032482 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-1adf0a66-f303-4bdf-aa62-c13e062c0b6a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Nov 02 20:24:05.032874 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:05.547688 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-aae8c4cf-acb4-47e8-ad9c-c333552ee53e admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:05.552647 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-aae8c4cf-acb4-47e8-ad9c-c333552ee53e admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-aae8c4cf-acb4-47e8-ad9c-c333552ee53e admin admin] Request method failure captured: Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Accept: application/json Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Connection: keep-alive Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Content-Length: 0 Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Host: 10.222.0.26 Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.92 Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABjYtHkb2Lmi1TMXVIQ9MpbqtluC7Y3dpGXyF1Ce0jSHLhAek7QCa5-LMh8jpclFBvQPQEznhFFpKs0HhkepWbON3uEozCvxL800VYyITPmTMf5Z3TTY80QBxHpfbiyklhs1rOgueXvc5sNzyqwYAhCQZmrM20VfNCXmxbsVR6pXvwYijU Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Role: admin,reader,member Nov 02 20:24:05.554132 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Roles: admin,reader,member Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}] Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant: admin Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User: admin Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Id: edd73f18c8a4441794facbca0f30e7c6 Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Name: admin Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: method: > Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: exception: Flavor 84 could not be found. Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: action_args: {'id': '84'} Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:24:05.555711 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:05.557022 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.558129 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-aae8c4cf-acb4-47e8-ad9c-c333552ee53e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:24:05.559234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-aae8c4cf-acb4-47e8-ad9c-c333552ee53e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386338 Nov 02 20:24:05.559234 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 20:24:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:05.565318 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-a7532207-70a1-4c5f-aff3-ca678e32802d admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:05.580586 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-a7532207-70a1-4c5f-aff3-ca678e32802d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018782 Nov 02 20:24:05.581110 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 20:24:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:24:05.591098 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-5968a1f7-2654-4090-876d-0e947e73fce7 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:05.606186 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-5968a1f7-2654-4090-876d-0e947e73fce7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019298 Nov 02 20:24:05.606708 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 20:24:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:24:05.615965 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-ea4c6cb7-1ea7-49a8-9558-78dc43d76d54 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:05.620906 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.wsgi [None req-ea4c6cb7-1ea7-49a8-9558-78dc43d76d54 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-ea4c6cb7-1ea7-49a8-9558-78dc43d76d54 admin admin] Request method failure captured: Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Accept: application/json Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Accept-Encoding: gzip, deflate Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Connection: keep-alive Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Content-Length: 0 Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Host: 10.222.0.26 Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Openstack-Api-Version: compute 2.92 Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Openstack-System-Scope: None Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: User-Agent: python-novaclient Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Auth-Token: gAAAAABjYtHkb2Lmi1TMXVIQ9MpbqtluC7Y3dpGXyF1Ce0jSHLhAek7QCa5-LMh8jpclFBvQPQEznhFFpKs0HhkepWbON3uEozCvxL800VYyITPmTMf5Z3TTY80QBxHpfbiyklhs1rOgueXvc5sNzyqwYAhCQZmrM20VfNCXmxbsVR6pXvwYijU Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Domain-Id: None Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Domain-Name: None Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Identity-Status: Confirmed Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Is-Admin-Project: True Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Domain-Id: default Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Domain-Name: Default Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Name: admin Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Role: admin,reader,member Nov 02 20:24:05.622399 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Roles: admin,reader,member Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}] Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant: admin Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant-Name: admin Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User: admin Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Domain-Id: default Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Domain-Name: Default Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Id: edd73f18c8a4441794facbca0f30e7c6 Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Name: admin Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: method: > Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: exception: Flavor 84 could not be found. Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: action_args: {'id': '84'} Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:24:05.624071 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:05.624855 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:05.625962 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-ea4c6cb7-1ea7-49a8-9558-78dc43d76d54 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:24:05.627014 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-ea4c6cb7-1ea7-49a8-9558-78dc43d76d54 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011417 Nov 02 20:24:05.627014 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 20:24:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 20:24:06.826359 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-5968a1f7-2654-4090-876d-0e947e73fce7 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:06.827357 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-5968a1f7-2654-4090-876d-0e947e73fce7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 02 20:24:06.827786 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:07.349150 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-c83f1d27-d6f5-4732-86b8-22a7fc2504d7 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:07.354994 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.wsgi [None req-c83f1d27-d6f5-4732-86b8-22a7fc2504d7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-c83f1d27-d6f5-4732-86b8-22a7fc2504d7 admin admin] Request method failure captured: Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Accept: application/json Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Accept-Encoding: gzip, deflate Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Connection: keep-alive Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Content-Length: 0 Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Host: 10.222.0.26 Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Openstack-Api-Version: compute 2.92 Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Openstack-System-Scope: None Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: User-Agent: python-novaclient Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Auth-Token: gAAAAABjYtHmgU_zS1MEWJtAxB3GBCc62OZrga1ularLGviRYEymN-S6wAMrk1n7dB8BE3i3nK-QiesZ_m9B7mXVy0QK9HQwdDxg2CyEy5HVJ4SjZOfMCiw2OXKcHA6EsnWVrUP3QgRYVcgGMuQg-OUSNAmF3mvbflVoUnV8fGnUqRW2cp5qDk8 Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Domain-Id: None Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Domain-Name: None Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Identity-Status: Confirmed Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Is-Admin-Project: True Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Domain-Id: default Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Domain-Name: Default Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Project-Name: admin Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Role: admin,reader,member Nov 02 20:24:07.356532 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Roles: admin,reader,member Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}] Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant: admin Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-Tenant-Name: admin Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User: admin Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Domain-Id: default Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Domain-Name: Default Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Id: edd73f18c8a4441794facbca0f30e7c6 Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: X-User-Name: admin Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: method: > Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: exception: Flavor 451 could not be found. Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: action_args: {'id': '451'} Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:24:07.358192 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:07.359102 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.360218 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-c83f1d27-d6f5-4732-86b8-22a7fc2504d7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:24:07.361202 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-c83f1d27-d6f5-4732-86b8-22a7fc2504d7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391515 Nov 02 20:24:07.361202 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 20:24:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 20:24:07.367412 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-dadb7d37-27c5-442c-ab24-733fd66cced6 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:07.382674 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-dadb7d37-27c5-442c-ab24-733fd66cced6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018829 Nov 02 20:24:07.383199 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 20:24:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:24:07.392983 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:07.407765 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018281 Nov 02 20:24:07.408289 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 20:24:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:24:07.417306 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4a2874fd-a5bc-4dde-852b-828672d52934 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:07.422296 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-4a2874fd-a5bc-4dde-852b-828672d52934 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4a2874fd-a5bc-4dde-852b-828672d52934 admin admin] Request method failure captured: Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Accept: application/json Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Connection: keep-alive Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Content-Length: 0 Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Host: 10.222.0.26 Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.92 Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABjYtHmgU_zS1MEWJtAxB3GBCc62OZrga1ularLGviRYEymN-S6wAMrk1n7dB8BE3i3nK-QiesZ_m9B7mXVy0QK9HQwdDxg2CyEy5HVJ4SjZOfMCiw2OXKcHA6EsnWVrUP3QgRYVcgGMuQg-OUSNAmF3mvbflVoUnV8fGnUqRW2cp5qDk8 Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Role: admin,reader,member Nov 02 20:24:07.423830 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Roles: admin,reader,member Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad760fbcd8624c14b1cb9ac55b83203f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad760fbcd8624c14b1cb9ac55b83203f"}]}] Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant: admin Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant-Id: ad760fbcd8624c14b1cb9ac55b83203f Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User: admin Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Id: edd73f18c8a4441794facbca0f30e7c6 Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: X-User-Name: admin Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: method: > Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: exception: Flavor 451 could not be found. Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: action_args: {'id': '451'} Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:24:07.425420 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:07.426506 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Nov 02 20:24:07.427814 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4a2874fd-a5bc-4dde-852b-828672d52934 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:24:07.429033 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4a2874fd-a5bc-4dde-852b-828672d52934 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011419 Nov 02 20:24:07.429033 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 20:24:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:08.629358 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:08.630370 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 02 20:24:08.630763 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:09.160549 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-7db750cb-701d-48e5-8546-f2715a0854c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:24:09.179581 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-7db750cb-701d-48e5-8546-f2715a0854c4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.412023 Nov 02 20:24:09.180171 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 20:24:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:24:10.380400 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:10.381420 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Nov 02 20:24:10.381813 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:10.900823 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-5438c7b5-dd0d-4c38-9aae-2f7ad8c678c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:24:10.919451 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-5438c7b5-dd0d-4c38-9aae-2f7ad8c678c4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401515 Nov 02 20:24:10.920027 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 20:24:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:24:12.125588 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:12.126595 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 02 20:24:12.126994 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:24:12.644482 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e43e594a-f267-4eb5-8738-a1a84e8fce90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:24:12.663763 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e43e594a-f267-4eb5-8738-a1a84e8fce90 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399492 Nov 02 20:24:12.664312 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 20:24:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:24:13.883957 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:13.884991 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Nov 02 20:24:13.885385 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:14.405206 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-56acddd9-3f81-435d-8469-7fbc8590e087 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:24:14.423994 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-56acddd9-3f81-435d-8469-7fbc8590e087 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399292 Nov 02 20:24:14.424539 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 20:24:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:24:15.627915 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:15.628922 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Nov 02 20:24:15.629318 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:24:16.144963 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-b12987fa-d7ee-4045-b900-765afeefef00 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:24:16.165604 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-b12987fa-d7ee-4045-b900-765afeefef00 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397800 Nov 02 20:24:16.166136 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Nov 2 20:24:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:25:12.584362 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:25:12.585292 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d6c2d17a-c346-45de-bc59-a4a2535684b9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Nov 02 20:25:12.585695 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 20:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:25:12.596630 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:12.975218 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-5ad25099-1723-47a2-92c9-d496627ffb39 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:25:12.995344 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-5ad25099-1723-47a2-92c9-d496627ffb39 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403142 Nov 02 20:25:12.995916 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 20:25:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:25:13.018263 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_api:SELECT=14 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:13.021978 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-d5bff5a2-9866-46e8-b449-31d239fe2d7e admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:25:13.030133 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-d5bff5a2-9866-46e8-b449-31d239fe2d7e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013283 Nov 02 20:25:13.030657 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Nov 2 20:25:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:25:13.042742 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-c03ab7a4-183e-4f35-9b0b-4905e715e935 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:25:13.050070 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-c03ab7a4-183e-4f35-9b0b-4905e715e935 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011282 Nov 02 20:25:13.050583 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Nov 2 20:25:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:25:13.062222 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:25:13.069377 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010671 Nov 02 20:25:13.069882 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Nov 2 20:25:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:25:13.081535 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-6c582144-908d-44d5-a5da-af1d698a0488 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:25:13.089376 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-6c582144-908d-44d5-a5da-af1d698a0488 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011323 Nov 02 20:25:13.089886 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Nov 2 20:25:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:28:07.123438 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:07.124543 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Nov 02 20:28:07.124941 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:28:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:28:07.267605 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=6 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:07.424148 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:07.428816 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:07.429291 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:07.429720 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:07.430432 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:07.430876 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:07.431293 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:07.464268 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-da9ff41f-1817-4099-b92d-1eb9df0551cf admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197912 Nov 02 20:28:07.464825 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 20:28:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:28:08.533793 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:08.534797 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Nov 02 20:28:08.535194 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:28:08.732379 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:08.737005 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:08.737515 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:08.738292 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:08.739070 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:08.739521 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:08.739970 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:08.761639 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-8c8e90a4-5cbb-440c-b644-675958e4e8b7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.084473 Nov 02 20:28:08.762209 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 20:28:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:28:20.251451 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:20.252484 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 02 20:28:20.252885 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:28:20.394673 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=4 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:20.395383 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell1:SELECT=4 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:20.396093 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=8 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:20.444087 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:20.447425 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:20.447927 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:20.448354 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:20.449058 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:20.449497 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:20.449908 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:20.476016 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-2a316d84-255b-4597-9120-f6faa1f1b26b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086548 Nov 02 20:28:20.476503 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 20:28:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:28:21.536294 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG nova.api.openstack.wsgi [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] Calling method '>' {{(pid=103723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:21.537315 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: INFO nova.api.openstack.requestlog [None req-47c26d41-f5ac-4476-be34-e27d195de4f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 02 20:28:21.537709 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: [pid: 103723|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 20:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:28:21.725837 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:28:21.729225 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:21.729828 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:21.730280 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:21.731287 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:28:21.731393 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:28:21.731836 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:28:21.754554 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-f205aa44-79a3-4c98-afc1-074a9a8005fd admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079122 Nov 02 20:28:21.755033 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 20:28:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:29:19.912417 dv-cinder-862365-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 20:29:19.912981 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: Wed Nov 2 20:29:19 2022 - graceful shutdown triggered... Nov 02 20:29:19.913454 dv-cinder-862365-5-iscsi devstack@n-api.service[103722]: Gracefully killing worker 1 (pid: 103722)... Nov 02 20:29:19.913961 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: Gracefully killing worker 2 (pid: 103723)... Nov 02 20:29:20.041143 dv-cinder-862365-5-iscsi devstack@n-api.service[103723]: DEBUG dbcounter [-] [103723] Writing DB stats nova_api:SELECT=4 {{(pid=103723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:29:20.914091 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: worker 1 buried after 1 seconds Nov 02 20:29:20.914538 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: worker 2 buried after 1 seconds Nov 02 20:29:20.914538 dv-cinder-862365-5-iscsi devstack@n-api.service[103721]: goodbye to uWSGI. Nov 02 20:29:20.915651 dv-cinder-862365-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 20:29:20.916233 dv-cinder-862365-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 20:29:20.918889 dv-cinder-862365-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 20:29:20.939825 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 20:29:20 2022] *** Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: nodename: dv-cinder-862365-5-iscsi Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: machine: x86_64 Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: clock source: unix Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: pcre jit disabled Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: detected number of CPU cores: 4 Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: current working directory: / Nov 02 20:29:20.941707 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: detected binary path: /usr/bin/uwsgi-core Nov 02 20:29:20.942473 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: your processes number limit is 47680 Nov 02 20:29:20.942473 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: your memory page size is 4096 bytes Nov 02 20:29:20.942473 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: detected max file descriptor number: 2048 Nov 02 20:29:20.942473 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: lock engine: pthread robust mutexes Nov 02 20:29:20.942473 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: thunder lock: enabled Nov 02 20:29:20.942473 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 20:29:20.942473 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 20:29:20.981084 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: Python main interpreter initialized at 0x55d0301459c0 Nov 02 20:29:20.981084 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: python threads support enabled Nov 02 20:29:20.981084 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: your server socket listen backlog is limited to 100 connections Nov 02 20:29:20.981084 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: your mercy for graceful operations on workers is 90 seconds Nov 02 20:29:20.981453 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 20:29:20.981453 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: *** Operational MODE: preforking *** Nov 02 20:29:20.981688 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: *** uWSGI is running in multiple interpreter mode *** Nov 02 20:29:20.981688 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: spawned uWSGI master process (pid: 118973) Nov 02 20:29:20.984115 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: spawned uWSGI worker 1 (pid: 118985, cores: 1) Nov 02 20:29:20.984115 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: spawned uWSGI worker 2 (pid: 118986, cores: 1) Nov 02 20:29:20.984115 dv-cinder-862365-5-iscsi devstack@n-api.service[118973]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 20:29:20.981881 dv-cinder-862365-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 20:29:21.645552 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 20:29:21.655193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 20:29:22.890690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:29:22.890690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: from cryptography.utils import int_from_bytes Nov 02 20:29:22.891290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:29:22.891290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: from cryptography.utils import int_from_bytes Nov 02 20:29:22.907080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:29:22.907080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: from cryptography.utils import int_from_bytes Nov 02 20:29:22.907643 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:29:22.907643 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: from cryptography.utils import int_from_bytes Nov 02 20:29:25.305885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 20:29:25.306430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 20:29:25.306658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 20:29:25.307019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 20:29:25.307274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 20:29:25.307678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.308005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.308593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.308910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.309237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.309543 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.309861 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.310175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.310499 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.310757 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.311075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.311393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-5-iscsi {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.311737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.312048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.312437 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.312917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.313243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.313566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.313872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.314373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.314817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.315127 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.315441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.315802 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.316117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.316425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.316743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.317049 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.317370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.317679 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.318072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-5-iscsi {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.318387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.318701 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.319029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.319423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.319757 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.320070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.320389 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.320708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.321013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.321345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.321661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.321979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.322297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.322596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.322902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.323215 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.323532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.323859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.324161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.324410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.324714 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.325031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.325348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.325668 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.325917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.326166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.326481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.326797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.327102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.327405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.327731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.328182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.328603 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.328915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.329225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.329532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.329852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.330168 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.330487 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.330793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.331113 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.331504 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.331816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.332126 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.332467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.332784 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.333099 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.333419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.333736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.334040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.334346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.334651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.334968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.335298 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.335601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.335872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.336171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.336475 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.336792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.337095 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.337398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.337702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.337999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.338302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.338606 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.338911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.339214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.339519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.339881 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.340147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.340453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.340757 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.341059 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.341376 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.341693 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.341998 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.342302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.342605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.342912 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.343232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.344103 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.344370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.344689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.344992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.345294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.345610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.345915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.346218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.346534 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.346832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.347136 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.347447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.347775 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.348082 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.348384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.348685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.348986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.349287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.349591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.349892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.350191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.350505 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.350823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.351132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.351435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.351758 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.351944 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 20:29:25.352352 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.352443 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 20:29:25.352541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.352717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.352810 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 20:29:25.353056 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.353175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 20:29:25.353327 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 20:29:25.353437 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.353700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.353860 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.354007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.354156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.354384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.354532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.354684 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.354821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.354970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.355119 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.355267 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.355421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.355561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.355786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.355942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.356096 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.356237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.356375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.356515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.356653 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.356798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.356945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.357092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-5-iscsi {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.357239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.357397 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.357564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.357701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.357851 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.357955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.358042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.358265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.358370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.358573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.358681 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.358896 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.358997 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.359839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.359958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.360162 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.360374 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.360493 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.360686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.360837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.360997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.361153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.361312 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.361477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.361651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.361800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.361967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.362113 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.362277 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.362424 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.362598 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.362734 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.362907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.363074 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.363232 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.363391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.363545 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.363729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.363986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-5-iscsi {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.364093 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.364304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.364397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.364619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.364725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.364934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.365027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.365254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.365347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.365567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.365663 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.365878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.365972 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.366188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.366285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.366523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.366618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.366840 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.366934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.367163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.367255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.367479 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.367580 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.367812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.367929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.368131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.368232 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.368432 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.368532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.368740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.368832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.369050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.369143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.369354 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.369448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.369657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.369758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.369960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.370073 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.370217 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.370330 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.370525 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.370634 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.370845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.370962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.371167 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.371268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.371470 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.371568 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.371754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.371874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.372004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.372133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.372325 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.372443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.372646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.372740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.372955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.373061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.373262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.373361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.373567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.373659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.373876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.374035 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.374188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.374346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.374487 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.374625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.374832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.375062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.375250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.375401 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.375542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.375741 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.375838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.375924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.376042 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.376146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.376350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.376452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.376671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.376773 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.377004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.377105 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.377307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.377407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.377613 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.377716 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.377935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.378041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.378245 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.378346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.378553 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.378652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.378874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.378968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.379199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.379298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.379503 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.379607 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.379835 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.379940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.380145 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.380248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.380468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.380592 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.380770 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.380946 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.381079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.381180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.381338 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.381430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.381640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.381742 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.381948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.382042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.382257 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.382355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.382559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.382662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.382861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.382954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.383163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.383264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.383461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.383584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.383786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.383893 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.384095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.384209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.384399 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.384494 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.384700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.384801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.385003 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.385096 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.385305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.385406 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.385611 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.385705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.385918 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.386020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.386223 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.386317 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.386527 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.386621 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.386845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.386940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.387163 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.387264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.387469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.387570 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.387805 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.387909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.388108 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.388199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.388412 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.388517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.388717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.388816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.389026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.389126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.389328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.389420 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.389641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.389740 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.389945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.390037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.390250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.390350 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.391111 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.391224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.391419 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.391528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.391808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.391915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.392116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.392216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.392432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.392525 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.392738 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.392839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.393057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.393151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.393364 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.393471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.393672 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.393765 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.393977 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.394100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.394284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.394402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.394585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.394680 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.394890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.394990 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.395194 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.395298 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.395496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.395597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.395831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.395925 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.396140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.396243 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.396459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.396560 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.396767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.396866 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.397075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.397178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.397380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.397481 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.397696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.397796 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:29:25.398000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.398095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.398318 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.398436 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.398665 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.398779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.398985 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.399094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.399289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.399391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.399598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.399717 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.399936 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.400029 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.400244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.400350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.400554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.400654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.400863 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.400955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.401167 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.401265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.401474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.401576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.401782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.401873 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.402096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.402250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.402404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.402510 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.402711 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.402804 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.403014 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.403115 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.403325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.403431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.403650 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.403759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.403956 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.404058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.404259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.404376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.404569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.404684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.404886 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.404980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.405195 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.405290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.405514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.405608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.405831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.405935 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.406751 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.406893 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.407061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.407385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.407477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.407717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.407831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.408025 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.408118 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.408331 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.408425 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.408636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.408738 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.408978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.409079 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.409286 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.409378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.409591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.409688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.409906 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.410009 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.410224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.410316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.410533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.410636 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.410848 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.410960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.411154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.411415 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.411527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.411639 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.411793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.411897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.412106 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.412210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.412413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.412515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.412723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.412816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.413030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.413138 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.413338 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.413439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.413650 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.413773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.413971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.414074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.414279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.414379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.414641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.414754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.414889 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.414993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.415190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.415284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.415496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.415594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.415832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.415935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.416145 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.416397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.416491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.416729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.416835 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.417043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.417144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.417361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.417461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.417696 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.417816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.418007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.418110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.418321 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.418421 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.418634 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.418735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.418945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.419057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.419251 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.419345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.419557 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.419690 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.419884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.419979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.420191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.420297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.420503 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.420612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.420807 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.420908 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.421112 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.421206 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.421427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.421544 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.421746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.421856 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.422051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.422220 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.422353 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.422543 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.422643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.422858 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.422953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.423174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.423266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.423492 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.423586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.423833 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.423930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.424158 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.424250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.424474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.424584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.424783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.424888 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.425087 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.425190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.425392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.425495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.425696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.425797 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.426039 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.426131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.426340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.426442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.426674 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.426775 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.426982 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.427075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.427295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.427397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.427602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.427732 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.427935 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.428037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.428244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.428393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.428545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.428637 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.428850 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.428949 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.429152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.429244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.429456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.429555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.429762 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.429862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.430065 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.430167 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.430375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.430475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.430682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.430782 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.430987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.431078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.431294 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.431395 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.431598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.431743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.431924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.432027 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.432229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.432330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.432545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.432649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.432855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.432953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.433159 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.433252 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.433733 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.433831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.434046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.434156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.434353 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.434448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.434660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.434779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.434967 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.435073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.435267 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.435415 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.435580 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.435719 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.435908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.435999 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.436385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.436478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.436559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.436640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.436808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.436902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.437115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.437217 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.437501 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.437595 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.437897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.438008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.438138 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.438242 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.438447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.438572 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.438749 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.438849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.439057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.439154 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.439361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.439456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.439685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.439795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.439995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.440098 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.440319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.440434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.440635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.440728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.440939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.441045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.441247 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.441342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.441551 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.441658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.441855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.442037 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.442157 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.442257 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.442464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.442564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.442765 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.442886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.443071 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.443227 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.443382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.443527 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.443725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.443864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.444015 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.444155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.444295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.444436 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.444587 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.444817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.444964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.445177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.445332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.445474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.445615 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.445757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.445899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.446047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.446188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.446336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.446490 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.446641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.446791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.446939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.447083 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.447180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.447297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.447381 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.447606 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.447728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.447932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.448041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.448243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.448336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.448545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.448643 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.448864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.449029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.449172 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.449276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.449481 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.449574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.449784 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.449890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.450088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.450181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.450403 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.450515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.450709 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.450825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.451020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.451114 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.451339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.451430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.451692 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.451782 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.452004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.452103 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.452311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.452420 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.452623 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.452729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.453454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.453561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.453767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.453885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.454084 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.454188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.454395 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.454493 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.454705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.454891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.455015 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.455134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.455312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.455434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.455638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.455763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.455960 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.456086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.456268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.456401 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.456577 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.456720 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.456886 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.457035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.457189 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.457348 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.457511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.457673 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.457821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.457989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.458171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.458301 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.458431 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.458614 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.458722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.458929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.459032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.459240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.459344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.459552 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.459902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.460008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.460220 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.460326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.460532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.460627 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.460847 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.460940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.461153 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.461260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.461466 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.461638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.461784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.462026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.462117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.462352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.462457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.462686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.462817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.463004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.463132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.463325 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.463446 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.463694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.463793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.464019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.464114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.464353 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.464455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.464675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.464821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.464995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.465114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.465295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.465418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.465601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.465727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.465901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.465997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.466208 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.466307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.466515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.466616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.466820 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.466912 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.467128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.467217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.467436 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.467531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.467772 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.467869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.468081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.468243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.468389 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.469151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.469426 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.469512 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.469785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.469929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.470107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.470263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.470430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.470573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.470722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.470880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.471028 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.471178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.471332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.471472 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.471705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.472117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.472209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.472302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.472388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.472523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.472630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.472907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.473040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.473229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.473319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.473557 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.473737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.473858 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.473971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.474186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.474375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.474586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.474913 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.474992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.475302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.475434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.475515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.475594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.475897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.476122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.476206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.476279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.476524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.476661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.476831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.476932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.477113 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.477242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.477476 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.477596 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.477740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.477914 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.478046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.478238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.478341 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.478558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.478661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.478874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.478977 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.479190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.479311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.479502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.479597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.479845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.479941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.480147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.480241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.480488 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.480591 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.480769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.480872 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.481079 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.481181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.481388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.481490 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.481691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.481793 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.482006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.482123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.482315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.482430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.482620 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.482717 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.482925 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.483032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.483229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.483337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.483538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.483652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.483890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.483997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.484747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.484860 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.485070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.485201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.485401 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.485519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.485710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.485805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.486036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.486146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.486355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.486452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.486666 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.486761 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.486971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.487073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.487284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.487387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.487593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.487726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.487922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.488028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.488225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.488323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.488536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.488639 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.488841 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.488949 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.489147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.489249 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.489452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.489563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.489758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.489861 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.490057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.490150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.490359 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.490453 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.490660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.490769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.490969 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.491070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.491271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.491372 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.491577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.491706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.491910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.492014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.492214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.492309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.492523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.492643 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.492824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.492919 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.493129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.493262 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.493440 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.493535 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.493746 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.493844 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.494072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.494173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.494385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.494487 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.494702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.494796 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.495016 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.495112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.495331 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.495441 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.495666 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.495823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.495989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.496104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.496298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.496410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.496610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.496703 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.496916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.497011 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.497230 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.497385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.497554 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.497645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.497859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.497963 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.498170 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.498411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.498506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.498746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.498848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.499060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.499154 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.499386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.499482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.499711 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.500412 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.500590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.500835 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.500943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.501031 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.501209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.501333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.501523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.501648 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.501834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.501966 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.502146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.502280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.502478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.502685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.502841 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.502999 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.503145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.503298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.503440 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.503581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.503766 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.503873 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.504085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.504182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.504403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.504505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.504717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.504821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.505028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.505116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.505342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.505436 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.505650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.505763 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506660 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506868 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.506963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.507173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.507266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.507485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.507580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.507822 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.507930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.508133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.508442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.508553 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.508756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.508859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.509071 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.509167 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.509396 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.509491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.509729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.509870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.510046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.510139 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.510357 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.510451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.510671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.510765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.510984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.511076 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.511408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.511502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.511749 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.511847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.512068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.512174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.512384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.512477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513069 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513192 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513546 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513714 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.513911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.514015 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.514221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.514323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.514528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.514636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.514845 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.514939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.515148 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.515265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.515513 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.515838 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.515951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.516040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.516272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.516380 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.516541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.516668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.516851 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.516960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.517260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.517381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.517590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.517736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.517913 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.518056 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.518205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.518382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.518533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.518708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.518843 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.519025 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.519160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.519333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.519472 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.519678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.519824 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.519990 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.520149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.520296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.520464 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.520615 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.520785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.520925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.521092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.521230 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.521417 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.521521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.521741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.521837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.522058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.522153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.522384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.522486 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.522712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.522823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.523018 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.523134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.523340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.523437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.523662 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.523763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.523969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.524076 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.524279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.524382 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.524589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.524686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.524893 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.524996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.525198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.525323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.525504 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.525600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.525810 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.525931 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.526118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.526365 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.526610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.526712 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.526808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.526910 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.526999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.527084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.527307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.527403 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.527649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.527783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.527980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.528091 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.528280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.528431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.528602 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.528708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.528907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.529010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.529210 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.529319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.529524 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.529628 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.529833 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.529936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.530153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.530248 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.530463 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.530559 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.530773 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.530867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.531130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.531241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.531460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.531585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.531975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.532078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.532290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.532393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.532617 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.532716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.532952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.533074 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.533287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.533404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.533601 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.533707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.533902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.533995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.534217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.534320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.534540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.534634 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.534849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.534944 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.535161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.535264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.535472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.535563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.535819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.535922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.536112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.536218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.536458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.536703 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.536808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.536898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.536994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.537090 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.537303 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.537400 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.537611 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.537753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.537914 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.538009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.538219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.538311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.538525 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.538627 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.538830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.538933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.539141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.539237 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.539463 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.539567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.539801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.539911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.540110 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.540204 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.540418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.540527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.540725 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.540826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.541032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.541126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.541341 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.541448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.541648 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.541742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.541954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.542057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.542266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.542370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.542592 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.542688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.542935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.543034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.543211 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.543325 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.543528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.543683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.543869 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.543978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.544186 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.544283 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.544507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.544608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.544818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.544922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.545138 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.545235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.545455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.545550 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.545775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.545891 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.546101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.546311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.546561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.547298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.547405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.547594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.547734 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.547954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.548056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.548271 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.548378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.548576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.548677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.548882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.548984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.549187 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.549288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.549496 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.549599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.549809 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.549913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.550118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.550224 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.550423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.550528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.550728 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.550828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.551035 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.551144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.551339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.551442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.551658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.551769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.551965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.552069 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.552317 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.552416 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.552575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.552660 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.552876 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.553064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.553170 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.553323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.553468 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.553726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.553832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.553929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.554060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.554242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.554361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.554560 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.554662 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.554875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.554979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.555189 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.555284 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.555507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.555603 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.555848 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.555952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.556151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.556245 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.556460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.556710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.556805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.556900 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.557081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.557176 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.557414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.557511 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.557700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.557810 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.558020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.558124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.558590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.558687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.558908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.559014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.559221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.559322 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.559554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.559768 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.559905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.560088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.560237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.560424 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.560549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.560751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.560846 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.561077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.561171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.561401 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.561497 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.561723 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.561817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.562045 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.562220 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.562924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.563040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.563235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.563338 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.563541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.563671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.563893 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.563997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.564202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.564296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.564525 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.564628 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.564837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.564938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.565146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.565240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.565467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.565562 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.565775 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.565869 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.566086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.566307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.566421 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.566702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.566817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.566975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.567070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.567286 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.567538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.567669 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.567762 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.567913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.568010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.568231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.568335 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.568555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.568656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.568860 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.568963 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.569168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.569265 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.569474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.569568 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.569786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.569886 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.570095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.570198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.570410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.570518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.570715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.570812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.571026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.571122 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.571333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.571427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.571667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.571783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.571975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.572078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.572302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.572398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.572549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 20:29:25.572654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.572903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.573211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.573531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.573828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.574133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.574440 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.574747 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.575059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.575365 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.575699 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.576007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.576324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.576682 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.576996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.577299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.577627 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.577979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.578562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.578847 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.579167 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.579490 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.579834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.581050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.581050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.581050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.581327 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.581668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.581994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.582333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.582667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.582976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.583286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.583591 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.583944 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.584258 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.584575 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.584888 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.585200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.585512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.585823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.586134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.586448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.586758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.587071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.587379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.587728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.588038 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.588347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.588663 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.589005 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.589324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.589642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.589958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.590275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.590587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.590899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.591209 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.591525 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.591864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.592196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.592513 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.592819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.593243 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.593599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.593969 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.594297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.594612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.594939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.595265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.595582 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.595943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.596258 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.596594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.596934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.597267 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.597595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.597907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.598214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.598520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.598832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.599153 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.599467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.599800 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.600111 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.600421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.600731 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.601038 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.601345 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.601655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.601969 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.602275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.602581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.602886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.603191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.603496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.603826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.604139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.604445 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.604751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.605057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.605362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.605665 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.605998 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.606332 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.606649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.606974 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.607288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.607648 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.607944 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.608264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.608587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.608906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.609767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.610467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.610787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.611104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.611423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.611764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.612086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.612402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.612732 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.613061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.613369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.613701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.614024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.614349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.614667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.614982 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.615313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.615641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.615961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.616276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.616589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.616900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.617220 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.617527 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.617837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.618155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.618472 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.618800 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.619124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.619435 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.619789 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.620119 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.620475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.620784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.621130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.621461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.621777 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.622099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.622406 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:29:25.622651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 20:29:25.635462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO dbcounter [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Registered counter for database nova_api Nov 02 20:29:25.656439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.663551 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writer thread running {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:25.685919 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO dbcounter [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Registered counter for database nova_api Nov 02 20:29:25.706416 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_db.sqlalchemy.engines [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.713130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writer thread running {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:25.720926 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.context [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1c810e1-7ff3-414d-8672-1a44e300f691(cell1) {{(pid=118985) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 20:29:25.725904 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:29:25.725904 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:29:25.727142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:29:25.727896 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:29:25.728344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:29:25.730372 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:29:25.732435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO dbcounter [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Registered counter for database nova_cell0 Nov 02 20:29:25.737385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO dbcounter [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Registered counter for database nova_cell1 Nov 02 20:29:25.744395 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.746074 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.752899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writer thread running {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:25.754205 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writer thread running {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:25.772590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.context [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1c810e1-7ff3-414d-8672-1a44e300f691(cell1) {{(pid=118986) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 20:29:25.776741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:29:25.777224 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:29:25.778826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:29:25.779548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:29:25.780054 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:29:25.782656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:29:25.784695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO dbcounter [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Registered counter for database nova_cell0 Nov 02 20:29:25.788894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO dbcounter [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Registered counter for database nova_cell1 Nov 02 20:29:25.800686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_db.sqlalchemy.engines [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.803277 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_db.sqlalchemy.engines [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.813234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writer thread running {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:25.818402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writer thread running {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:25.904213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO dbcounter [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Registered counter for database nova_cell0 Nov 02 20:29:25.911929 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.916693 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writer thread running {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:25.966314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO dbcounter [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Registered counter for database nova_cell0 Nov 02 20:29:25.973895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_db.sqlalchemy.engines [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:29:25.978621 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writer thread running {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:29:26.237925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: WARNING keystonemiddleware.auth_token [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:29:26.245153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: WARNING keystonemiddleware.auth_token [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:29:26.301779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: WARNING keystonemiddleware.auth_token [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:29:26.309390 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: WARNING keystonemiddleware.auth_token [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:29:26.591503 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: WARNING keystonemiddleware.auth_token [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:29:26.597606 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: WARNING keystonemiddleware.auth_token [None req-6d2055d9-b285-43e0-ad94-79e47033389a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:29:26.603079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0301459c0 pid: 118985 (default app) Nov 02 20:29:26.656639 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: WARNING keystonemiddleware.auth_token [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 20:29:26.662640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: WARNING keystonemiddleware.auth_token [None req-20bdc671-f2ee-4ee2-ba48-4d0d71a77126 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 20:29:26.668121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0301459c0 pid: 118986 (default app) Nov 02 20:30:02.151852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:02.153418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:02.154918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:02.156700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:03.346256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f03578e3-2f55-4c6b-9357-82f0fa2067cd tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Action: 'create', calling method: .version_select at 0x7f2e2325b940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-438071621"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:04.846500 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f03578e3-2f55-4c6b-9357-82f0fa2067cd tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.705075 Nov 02 20:30:04.859627 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Nov 2 20:30:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2720 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 02 20:30:05.154167 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a2cebf2c-56ce-423b-9861-035d7bcaf951 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e23289a60>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:05.186638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:05.187858 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:05.189028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:05.190280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:05.713259 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a2cebf2c-56ce-423b-9861-035d7bcaf951 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047" status: 200 len: 344 microversion: 2.1 time: 0.849622 Nov 02 20:30:05.721803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:30:04 2022] GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 => generated 344 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:06.732945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0dc809d6-9609-4e6c-ab63-8caf7fea16ba tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e230a6e50>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:06.828316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0dc809d6-9609-4e6c-ab63-8caf7fea16ba tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047" status: 200 len: 345 microversion: 2.1 time: 0.101870 Nov 02 20:30:06.828637 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:30:06 2022] GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:06.842541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7a9ea97f-1721-466f-b5a9-2c13ee07198b tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Action: 'create', calling method: .version_select at 0x7f2e230dcd30>, body: {"snapshot": {"volume_id": "b09c14d1-b478-4482-8189-99da49774047", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2082979503"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:07.390333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7a9ea97f-1721-466f-b5a9-2c13ee07198b tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.551575 Nov 02 20:30:07.400231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 2/4] 10.222.0.26 () {60 vars in 1162 bytes} [Wed Nov 2 20:30:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:07.413441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-74821c9c-dc0d-4f50-a823-6af04bd97be8 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303e550>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:07.571401 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-74821c9c-dc0d-4f50-a823-6af04bd97be8 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.163853 Nov 02 20:30:07.572044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:07 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:07.585905 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0a2d0597-0b0c-4cb2-8e42-a350c03211d9 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e230a5c10>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:07.831422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0a2d0597-0b0c-4cb2-8e42-a350c03211d9 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.251605 Nov 02 20:30:07.832299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Nov 2 20:30:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:07.845333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5d1a34b3-a763-4406-85ad-be30005cb581 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303eca0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:07.915375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5d1a34b3-a763-4406-85ad-be30005cb581 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.075563 Nov 02 20:30:07.916325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:07 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:08.928984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-802c20a7-9a8b-48b6-9fa4-cf69a1ec051f tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e230a5b80>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:09.022506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-802c20a7-9a8b-48b6-9fa4-cf69a1ec051f tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.098113 Nov 02 20:30:09.023086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:08 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:10.034989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f2bf76db-30ca-411b-9757-62cf03608ba3 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303eb80>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:10.102068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f2bf76db-30ca-411b-9757-62cf03608ba3 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.070969 Nov 02 20:30:10.102865 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:10 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:11.115578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e9015925-b79e-4130-af3b-eda7795aec45 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303a9d0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:11.163237 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e9015925-b79e-4130-af3b-eda7795aec45 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.051358 Nov 02 20:30:11.163912 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:11 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:12.176904 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-62bed7a1-b220-4335-8ba5-31b22457f792 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303e4c0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:12.271576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-62bed7a1-b220-4335-8ba5-31b22457f792 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.097195 Nov 02 20:30:12.272820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:12 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:13.290293 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-102f8e86-e0b8-4554-b980-106b2b8e122e tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303a3a0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:13.371710 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-102f8e86-e0b8-4554-b980-106b2b8e122e tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.085794 Nov 02 20:30:13.372227 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:13 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:14.387386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3e711485-1e06-42b0-a7aa-f3ab6f70c282 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e230a6ee0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:14.465659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3e711485-1e06-42b0-a7aa-f3ab6f70c282 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 288 microversion: 2.1 time: 0.082802 Nov 02 20:30:14.467228 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:14 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:14.485680 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-77b99ac3-bedc-4b88-be37-fdd782ea41b0 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e230a5a60>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:14.649653 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-77b99ac3-bedc-4b88-be37-fdd782ea41b0 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 202 len: 0 microversion: 2.1 time: 0.173532 Nov 02 20:30:14.650599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Nov 2 20:30:14 2022] DELETE /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:30:14.661935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-53887625-347a-435c-8e99-11144369e097 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2304b3a0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:14.761405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-53887625-347a-435c-8e99-11144369e097 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 200 len: 287 microversion: 2.1 time: 0.105245 Nov 02 20:30:14.762081 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:14 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:15.782288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ff1e0af6-edec-476f-b646-34b9317f5589 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303aee0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:15.828597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-ff1e0af6-edec-476f-b646-34b9317f5589 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] HTTP exception thrown: Snapshot 9ced7624-3146-4667-bf68-6d3376e48f61 could not be found. Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ff1e0af6-edec-476f-b646-34b9317f5589 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Request method failure captured: Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 HTTP/1.1 Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNK9PdUzlQ9Je-at8_80ryhRqLIL-CIZNLWFGhtP-QIL1Pajl_m9H2dWiE69XXFqgWmaVgyAJi4Ap3m_iVLZgSRlvCEXocRer8GTrVsCK5PwWHMOI6rAfyV7375j9rD4WrHpPzx-w08h6bwAp7MknM_gS1M5qm69F4fydY5T8AOIc4 Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:30:15.833359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}] Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 0f0ebb0b8a114e99b36ddfbb3986f588 Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Snapshot 9ced7624-3146-4667-bf68-6d3376e48f61 could not be found. Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '9ced7624-3146-4667-bf68-6d3376e48f61'} Nov 02 20:30:15.834828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9ced7624-3146-4667-bf68-6d3376e48f61 could not be found. (HTTP 404) (Request-ID: req-13b6b83f-36eb-4b13-b230-85c022bb811a) Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:15.835708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:30:15.836841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9ced7624-3146-4667-bf68-6d3376e48f61 could not be found. Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 20:30:15.837975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9ced7624-3146-4667-bf68-6d3376e48f61 could not be found. Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9ced7624-3146-4667-bf68-6d3376e48f61 could not be found. Nov 02 20:30:15.839447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:15.841498 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ff1e0af6-edec-476f-b646-34b9317f5589 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Returning 404 to user: Snapshot 9ced7624-3146-4667-bf68-6d3376e48f61 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:30:15.842688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ff1e0af6-edec-476f-b646-34b9317f5589 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61" status: 404 len: 111 microversion: 2.1 time: 0.071551 Nov 02 20:30:15.844322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:30:15 2022] GET /compute/v2.1/os-snapshots/9ced7624-3146-4667-bf68-6d3376e48f61 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:30:15.853294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8dc39c7c-f6f3-474b-af77-8dff58b8ef19 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e230a6ee0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:15.958809 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8dc39c7c-f6f3-474b-af77-8dff58b8ef19 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047" status: 202 len: 0 microversion: 2.1 time: 0.109723 Nov 02 20:30:15.961861 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:30:15 2022] DELETE /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:30:15.971546 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-247de18d-a42f-49ac-9994-faad7e76c803 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2301c3a0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:16.079704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-247de18d-a42f-49ac-9994-faad7e76c803 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047" status: 200 len: 344 microversion: 2.1 time: 0.115440 Nov 02 20:30:16.080614 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:30:15 2022] GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:30:17.113013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f07c5a8b-8c97-442d-877f-18ca825d0cf8 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2303e4c0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:17.175440 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-f07c5a8b-8c97-442d-877f-18ca825d0cf8 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] HTTP exception thrown: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f07c5a8b-8c97-442d-877f-18ca825d0cf8 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Request method failure captured: Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 HTTP/1.1 Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNK9PdUzlQ9Je-at8_80ryhRqLIL-CIZNLWFGhtP-QIL1Pajl_m9H2dWiE69XXFqgWmaVgyAJi4Ap3m_iVLZgSRlvCEXocRer8GTrVsCK5PwWHMOI6rAfyV7375j9rD4WrHpPzx-w08h6bwAp7MknM_gS1M5qm69F4fydY5T8AOIc4 Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:30:17.183517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}] Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 0f0ebb0b8a114e99b36ddfbb3986f588 Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'b09c14d1-b478-4482-8189-99da49774047'} Nov 02 20:30:17.185457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. (HTTP 404) (Request-ID: req-0b87ffef-b324-4bd0-887f-67fc093967b3) Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.186458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:30:17.187817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 20:30:17.188942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f07c5a8b-8c97-442d-877f-18ca825d0cf8 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Returning 404 to user: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f07c5a8b-8c97-442d-877f-18ca825d0cf8 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047" status: 404 len: 109 microversion: 2.1 time: 0.080468 Nov 02 20:30:17.190063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:30:17 2022] GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:30:17.222071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0ff59066-9fa2-4ff3-9fdd-8f49e2ee6e24 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2301caf0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:17.354464 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-0ff59066-9fa2-4ff3-9fdd-8f49e2ee6e24 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] HTTP exception thrown: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0ff59066-9fa2-4ff3-9fdd-8f49e2ee6e24 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Request method failure captured: Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: DELETE /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 HTTP/1.1 Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNK9PdUzlQ9Je-at8_80ryhRqLIL-CIZNLWFGhtP-QIL1Pajl_m9H2dWiE69XXFqgWmaVgyAJi4Ap3m_iVLZgSRlvCEXocRer8GTrVsCK5PwWHMOI6rAfyV7375j9rD4WrHpPzx-w08h6bwAp7MknM_gS1M5qm69F4fydY5T8AOIc4 Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:30:17.357176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}] Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 0f0ebb0b8a114e99b36ddfbb3986f588 Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'b09c14d1-b478-4482-8189-99da49774047'} Nov 02 20:30:17.359107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. (HTTP 404) (Request-ID: req-b18339ac-8de0-467c-8ad9-0a4f283f7234) Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.360047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 20:30:17.361151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 20:30:17.362284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0ff59066-9fa2-4ff3-9fdd-8f49e2ee6e24 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Returning 404 to user: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:30:17.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0ff59066-9fa2-4ff3-9fdd-8f49e2ee6e24 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047" status: 404 len: 109 microversion: 2.1 time: 0.156203 Nov 02 20:30:17.367883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d619a471-fc56-410d-9293-7bc5cdf53fc1 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Calling method '.version_select at 0x7f2e2304b1f0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:17.374146 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 10/20] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:30:17 2022] DELETE /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:30:17.465227 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-d619a471-fc56-410d-9293-7bc5cdf53fc1 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] HTTP exception thrown: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d619a471-fc56-410d-9293-7bc5cdf53fc1 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Request method failure captured: Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 HTTP/1.1 Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNK9PdUzlQ9Je-at8_80ryhRqLIL-CIZNLWFGhtP-QIL1Pajl_m9H2dWiE69XXFqgWmaVgyAJi4Ap3m_iVLZgSRlvCEXocRer8GTrVsCK5PwWHMOI6rAfyV7375j9rD4WrHpPzx-w08h6bwAp7MknM_gS1M5qm69F4fydY5T8AOIc4 Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:30:17.467261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f1fe8452c024384be19ec3842918d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f1fe8452c024384be19ec3842918d1f"}]}] Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 9f1fe8452c024384be19ec3842918d1f Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917279597 Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 0f0ebb0b8a114e99b36ddfbb3986f588 Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917279597-project Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'b09c14d1-b478-4482-8189-99da49774047'} Nov 02 20:30:17.468940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. (HTTP 404) (Request-ID: req-6f1d679d-fde0-41f9-ade3-1b1c17d8b7a9) Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.469958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:30:17.471295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 20:30:17.473690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d619a471-fc56-410d-9293-7bc5cdf53fc1 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] Returning 404 to user: Volume b09c14d1-b478-4482-8189-99da49774047 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d619a471-fc56-410d-9293-7bc5cdf53fc1 tempest-VolumesSnapshotsTestJSON-917279597 tempest-VolumesSnapshotsTestJSON-917279597-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047" status: 404 len: 109 microversion: 2.1 time: 0.106569 Nov 02 20:30:17.476313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:30:17 2022] GET /compute/v2.1/os-volumes/b09c14d1-b478-4482-8189-99da49774047 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:30:17.798391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d8203599-2775-4844-b6bf-8a0ddef0e7c3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'create', calling method: .version_select at 0x7f2e2301c4c0>, body: {"keypair": {"name": "tempest-keypair-994649002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkIxNnN+cdkJT8WKAByusWyhELJBJiVzgbU7nz2Kqg9sEGff1VMLrFDwofh5eY+rteg6wfpAh4Lw+I6OJAXTNPWmhKd+l/H4OfkqM36o6T5NvTWHXJYN6XGcXpICba7Tg=="}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:17.905078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-d8203599-2775-4844-b6bf-8a0ddef0e7c3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:17.921517 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-d8203599-2775-4844-b6bf-8a0ddef0e7c3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for user aa1a7490162d4aeaa1f96da542fea26f and project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:18.048212 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d8203599-2775-4844-b6bf-8a0ddef0e7c3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.523078 Nov 02 20:30:18.051358 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 11/22] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:30:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:20.231381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5984d628-1d1b-461c-b810-fe46c1a55996 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: .version_select at 0x7f2e2304b670>, body: {"keypair": {"name": "tempest-keypair-754150780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM42tmE5bwC0o2FNAd6ySfbPovhwrB2qkvD+QMOyYt5ahwsaWZaxKODNXR4j93WflA648vXpG+WZBeAz1tubj6BocMlBQtGaxgLCOVTAGFvqDB0+a0nMQSm2jqiFO5RA=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:20.344786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-5984d628-1d1b-461c-b810-fe46c1a55996 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:20.367009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-5984d628-1d1b-461c-b810-fe46c1a55996 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:20.490935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5984d628-1d1b-461c-b810-fe46c1a55996 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.190430 Nov 02 20:30:20.500383 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 12/23] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:30:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:27.434983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-544698002", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27307d29-55f5-441e-b481-a0816c6cabad"}], "security_groups": [{"name": "tempest-securitygroup--1708285528"}], "key_name": "tempest-keypair-994649002", "user_data": "}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:27.946454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] validate_networks() for [('27307d29-55f5-441e-b481-a0816c6cabad', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:30:27.958854 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:28.034675 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:28.296351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-591341790", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "networks": [{"uuid": "4347e575-264d-4f16-99d2-8cd24bd2e4ca"}]}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:28.517512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] validate_networks() for [('4347e575-264d-4f16-99d2-8cd24bd2e4ca', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:30:30.105676 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:30:30.106964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:30:30.108683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:30:30.109408 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:30:30.110053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:30:30.140676 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:30.141446 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:30.142083 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:30.144096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:30.148495 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:30.151601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:30.227819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:30.237047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for user aa1a7490162d4aeaa1f96da542fea26f and project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:30.276781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:30:30.287117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:30:30.510598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-057de9b0-4450-4b57-8293-0f34f77f4822 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.082195 Nov 02 20:30:30.524363 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 13/24] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:30:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 3097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:30:30.690689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:30:30.691835 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:30:30.692573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:30:30.694150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:30:30.694741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:30:30.717023 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:30.717733 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:30.718626 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:30.719547 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:30.720166 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:30.720874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:30.757064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Getting quotas for project 5257c2c600454a4aa4b37dfc35c6a5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:30.769992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Getting quotas for user bdcf2fcd264e470094e30cfe9b154486 and project 5257c2c600454a4aa4b37dfc35c6a5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:30.799764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:30:30.804146 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:30:30.940205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e152fc1f-c7f2-48d1-af06-46140cb817be tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.809982 Nov 02 20:30:30.950677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 12/25] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:30:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:30:30.984476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1240081894", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb4fd267-779a-4c9f-9357-f71bbe07a717"}], "security_groups": [{"name": "tempest-securitygroup--918571155"}], "key_name": "tempest-keypair-754150780", "user_data": "}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:31.224989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7e4d3b7c-f453-433c-b8e9-e0b112753c9b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'create', calling method: .version_select at 0x7f2e22ed5940>, body: {"keypair": {"name": "tempest-keypair-1276025961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNJ2VvzQDLeVtncM5OcGDqgp/xH2bW4fOTFjk1WE2CId+Olx7rOAH1LUYeyrAFuEDgDO7i1HxUErajnlWyfioN3aAz4WkohmrbhTmrippDOfBgq6KpzCeKoWd84al37A=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:31.272742 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-7e4d3b7c-f453-433c-b8e9-e0b112753c9b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:31.284072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-7e4d3b7c-f453-433c-b8e9-e0b112753c9b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for user 3a86b6b9d9f54b3680efc6f3b93af3db and project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:31.361567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7e4d3b7c-f453-433c-b8e9-e0b112753c9b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.835190 Nov 02 20:30:31.363210 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 14/26] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Nov 2 20:30:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 838 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 20:30:31.383112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] validate_networks() for [('eb4fd267-779a-4c9f-9357-f71bbe07a717', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:30:32.351270 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-356810380", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:32.510095 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] validate_networks() for [('b8d241b6-91fd-447f-9430-f03282f71e74', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:30:32.524891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:30:32.525420 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:30:32.525779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:30:32.526393 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:30:32.526960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:30:32.544835 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:32.548274 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:32.556561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:32.557422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:32.562765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:32.565098 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:32.631543 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:32.648004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:32.696991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:30:32.703668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:30:32.884199 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-db2a2a06-f9d4-48df-b0f9-5d9595d9e0bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.930394 Nov 02 20:30:32.889450 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 13/27] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:30:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:30:32.909895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-33741993-1df3-439d-b57b-90969c166c75 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:32.910890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-33741993-1df3-439d-b57b-90969c166c75 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:33.593484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-33741993-1df3-439d-b57b-90969c166c75 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:33.662394 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-33741993-1df3-439d-b57b-90969c166c75 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1236 microversion: 2.1 time: 0.767930 Nov 02 20:30:33.676922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:32 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1236 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:33.685922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4b0f9791-41f2-4114-b54b-fbad1d443e2a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:33.687323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4b0f9791-41f2-4114-b54b-fbad1d443e2a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:33.986691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:30:33.987192 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:30:33.989311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:30:33.989749 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:30:33.990171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:30:34.012863 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:34.013349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:34.013793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:34.015120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:34.015571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:34.020191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:34.075323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:34.098567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for user 8fd4a5629fff47a69cf26196dbdee674 and project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:34.163827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:30:34.176580 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:30:34.195268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4b0f9791-41f2-4114-b54b-fbad1d443e2a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:34.226826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4b0f9791-41f2-4114-b54b-fbad1d443e2a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1214 microversion: 2.1 time: 0.531169 Nov 02 20:30:34.230270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:33 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1214 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:34.251557 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-74c32267-709d-4480-be14-cde09201167a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:34.268326 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-74c32267-709d-4480-be14-cde09201167a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:34.441738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5bf374ca-3f5d-4fdc-bb64-98fd7b375a57 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.070465 Nov 02 20:30:34.443567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 15/30] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:30:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:30:34.460853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c4465b62-546f-412e-8165-df87380ada72 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:34.461759 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c4465b62-546f-412e-8165-df87380ada72 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:34.587372 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-74c32267-709d-4480-be14-cde09201167a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:34.621946 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-74c32267-709d-4480-be14-cde09201167a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1241 microversion: 2.1 time: 0.378709 Nov 02 20:30:34.629878 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:34 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1241 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:34.690190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:34.691061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:34.718832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:34.720955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:34.733256 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:34.739050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:34.741926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:34.744198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:35.440761 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c4465b62-546f-412e-8165-df87380ada72 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:35.478616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:35.497027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c4465b62-546f-412e-8165-df87380ada72 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1221 microversion: 2.1 time: 1.041234 Nov 02 20:30:35.507772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:34 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1221 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:35.507772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4be25989-06e7-428e-8cb7-7bbee4f198cd tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:35.507772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4be25989-06e7-428e-8cb7-7bbee4f198cd tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:35.518891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a0cd25a2-8de6-459a-bf26-32a14275fffd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1232 microversion: 2.1 time: 0.832923 Nov 02 20:30:35.519489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:34 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1232 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:35.652607 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:35.654059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:35.678213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:35.678213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:35.678431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:35.693980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:35.701965 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:35.704171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:35.924981 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4be25989-06e7-428e-8cb7-7bbee4f198cd tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:35.934644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4be25989-06e7-428e-8cb7-7bbee4f198cd tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1214 microversion: 2.1 time: 0.434643 Nov 02 20:30:35.935224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 17/34] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:35 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1214 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:35.949576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:35.989561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d5cb733e-8609-4418-a8ac-e82f8aecb29c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1237 microversion: 2.1 time: 0.341783 Nov 02 20:30:35.993803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 18/35] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:35 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1237 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:36.176937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1527635073", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:36.316923 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] validate_networks() for [('b8d241b6-91fd-447f-9430-f03282f71e74', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:30:36.549574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:36.550577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:36.560059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:36.560584 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:36.581452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:36.582579 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:36.582685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:36.589130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:37.016917 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:37.041100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ea32e1a7-1ba2-4dad-b0c7-9c69ec625a93 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1296 microversion: 2.1 time: 0.498850 Nov 02 20:30:37.069367 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 19/36] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:36 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1296 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:37.078434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:37.096203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:37.118727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:37.119924 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:37.124052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:37.131151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:37.139702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:37.140532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:37.400143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:37.408813 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-991cd2ee-5a64-4d1a-87ca-19661ea5d267 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1210 microversion: 2.1 time: 0.335348 Nov 02 20:30:37.412131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 20/37] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:37 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1210 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:37.439881 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:37.444477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:37.475305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:37.481786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:37.483413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:37.492157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:37.498325 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:37.500127 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:38.023520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:38.037460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-eefc8e0f-f825-4b09-aeee-2c21101c70d1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1293 microversion: 2.1 time: 0.611624 Nov 02 20:30:38.055640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 21/38] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:37 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1293 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:38.096485 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:38.097229 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:38.104057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:38.108918 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:38.113323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:38.114491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:38.115541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:38.117721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:38.745231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:38.765646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-833903e0-3e26-4781-86d5-6e0941027d76 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1294 microversion: 2.1 time: 0.690003 Nov 02 20:30:38.787403 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:38 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1294 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:38.799212 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:38.800277 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:38.820788 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:38.821319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:38.821794 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:38.822548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:38.823038 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:38.823750 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:39.091009 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:39.110726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c3af5e71-613f-49b7-805d-ba75d6d5be3f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1272 microversion: 2.1 time: 0.321884 Nov 02 20:30:39.111224 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 23/40] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:38 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:39.136109 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:39.137726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:39.149068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:39.149739 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:39.151390 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:39.152449 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:39.153081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:39.153673 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:39.449064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:39.490897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b918e5a2-b0d7-42c7-ab29-383f868aaa8c tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1299 microversion: 2.1 time: 0.352858 Nov 02 20:30:39.516825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 24/41] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:39 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1299 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:39.524434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:30:39.526535 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:30:39.528519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:30:39.529169 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:30:39.531030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:30:39.567729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:39.572324 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:39.577390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:39.581377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:39.586155 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:39.586836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:39.699935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:39.720357 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for user 8fd4a5629fff47a69cf26196dbdee674 and project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:39.790976 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:30:39.801698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:39.802322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:39.805707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:30:39.808735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:39.809402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:39.809843 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:39.834176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:39.843906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:39.844435 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:40.101721 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bda5c0ce-ce87-4259-a274-0a96b07bf29d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.930451 Nov 02 20:30:40.102373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 18/42] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:30:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 3932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:30:40.142422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-76a385d8-72e9-4ee3-a1cf-8f8b393784f8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:40.143054 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-76a385d8-72e9-4ee3-a1cf-8f8b393784f8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:40.437623 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:40.460240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0dbbda4a-9615-4160-ac53-dab1ffd44b61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1294 microversion: 2.1 time: 0.662121 Nov 02 20:30:40.462690 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 25/43] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:39 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1294 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:40.492955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:40.496491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:40.519879 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:40.526615 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:40.527882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:40.532538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:40.533046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:40.533487 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:40.848567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:40.857098 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c115f9fa-c234-4993-b803-479d8771dc6f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1272 microversion: 2.1 time: 0.390653 Nov 02 20:30:40.874807 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 26/44] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:40 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1272 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:40.901000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1454249000", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7813bd1-69e8-43fc-9008-ebd5992e8c67"}], "security_groups": [{"name": "tempest-securitygroup--370142456"}], "key_name": "tempest-keypair-1276025961", "user_data": "}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:40.961875 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-76a385d8-72e9-4ee3-a1cf-8f8b393784f8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:40.984046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-76a385d8-72e9-4ee3-a1cf-8f8b393784f8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1222 microversion: 2.1 time: 0.864064 Nov 02 20:30:40.987254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 19/45] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:40 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1222 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:41.003922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:41.008631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:41.068077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:41.070312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:41.071937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:41.075442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:41.078262 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:41.079162 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:41.765659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:41.825829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7c48b866-2ca0-4a37-aa11-24b64f82dd37 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1299 microversion: 2.1 time: 0.836253 Nov 02 20:30:41.848718 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 20/46] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:40 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1299 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:41.883578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:41.900408 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:41.943770 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:41.963097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:41.964379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:41.965467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:41.969214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:41.970520 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:42.594848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:42.841829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:42.857220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0026b4d6-abf1-4327-81ec-c02309584afd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1294 microversion: 2.1 time: 1.001532 Nov 02 20:30:42.865930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 21/47] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:41 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1294 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:42.884218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:42.885094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:42.887648 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:42.912040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] validate_networks() for [('c7813bd1-69e8-43fc-9008-ebd5992e8c67', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:30:42.923199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:42.926802 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:42.927320 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:42.928130 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:42.928621 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:42.929181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:44.609966 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=18 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:45.148280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:45.161594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0377c244-b816-481d-9750-83571c973dcb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 2.294227 Nov 02 20:30:45.162186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 22/48] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:42 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:45.180752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:45.183402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:45.204549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:45.205366 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:45.206109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:45.207400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:45.208076 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:45.213102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:45.769044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:45.785781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1fe29370-2f18-46ca-8cec-57bfbca5e073 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1280 microversion: 2.1 time: 0.616603 Nov 02 20:30:45.789840 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 23/49] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:45 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1280 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:45.836861 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:45.842651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:45.894754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:45.906016 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:45.907353 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:45.913141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:45.916452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:45.923324 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:46.452419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:46.478023 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7140ee59-8c07-4e0c-8204-73345efe048b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1299 microversion: 2.1 time: 0.686704 Nov 02 20:30:46.478787 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 24/50] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:45 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1299 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:46.494425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:46.494425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:46.526517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:46.532412 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:46.534741 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:46.536661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:46.540628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:46.544037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:47.489856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:47.505238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-62f98267-ec37-4885-ba51-373fd0d1999d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 1.025236 Nov 02 20:30:47.517033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 25/51] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:46 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:47.529067 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:47.530768 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:47.546557 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:47.552233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:47.554651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:47.562283 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:47.563883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:47.565875 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:47.976711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:30:47.978649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:30:47.979391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:30:47.980003 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:30:47.980577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:30:48.013195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.014081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.014609 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.015307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.020954 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.021713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.093902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:30:48.114033 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for user 3a86b6b9d9f54b3680efc6f3b93af3db and project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:30:48.130481 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:30:48.134519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:30:48.220670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-78aea6e2-d981-4838-bddb-1247d2135a8b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 7.344589 Nov 02 20:30:48.221916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 27/52] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Nov 2 20:30:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 7349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 20:30:48.227135 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:48.228114 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:48.247324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.248940 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.251724 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.257322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.258903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.263026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.363357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:48.380662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5cd1b5d9-2b77-4b2f-8717-af41ca05ee87 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1280 microversion: 2.1 time: 0.153162 Nov 02 20:30:48.381611 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:48 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:48.387696 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:48.388744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:48.396601 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.398019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.399023 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.400429 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.401366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.402036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.575427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:48.588402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-53df0744-40f0-4737-a148-1468d27814d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 1.076453 Nov 02 20:30:48.590100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 26/54] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:47 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:48.598048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-00cd1a10-69f5-488f-b7e6-7f2cf5ae79ef tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:48.600348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-00cd1a10-69f5-488f-b7e6-7f2cf5ae79ef tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:48.755994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:48.767459 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ccb37b7c-aba4-43d2-903c-c5f99f108450 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.384170 Nov 02 20:30:48.768763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 29/55] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:48 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:48.774029 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:48.775089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:48.781787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.782503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.783119 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.784588 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:48.785393 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:48.786007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:48.841220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-00cd1a10-69f5-488f-b7e6-7f2cf5ae79ef tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:48.844010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=33 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:48.851600 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-00cd1a10-69f5-488f-b7e6-7f2cf5ae79ef tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:48.853133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-00cd1a10-69f5-488f-b7e6-7f2cf5ae79ef tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:48.861378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-00cd1a10-69f5-488f-b7e6-7f2cf5ae79ef tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1282 microversion: 2.20 time: 0.269780 Nov 02 20:30:48.868313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 27/56] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:48 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:30:48.977976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:48.989352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e3159e52-036e-432c-a2ba-0192d91dfa82 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.219161 Nov 02 20:30:48.990206 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 30/57] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:48 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:49.408113 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:49.408784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:49.414824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-c1026291-757e-4de7-9484-251e9298d8ad req-aff6329a-a888-4078-9080-4e6fb5282f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b480405-4306-48e6-9bca-1f90443f0bd0", "tag": "8ea050fb-d23a-40db-97f4-4c903e422a1e"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:49.414987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.415352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.415812 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.416581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.417038 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.417456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.428652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c1026291-757e-4de7-9484-251e9298d8ad req-aff6329a-a888-4078-9080-4e6fb5282f9b service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.429386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c1026291-757e-4de7-9484-251e9298d8ad req-aff6329a-a888-4078-9080-4e6fb5282f9b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.429878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c1026291-757e-4de7-9484-251e9298d8ad req-aff6329a-a888-4078-9080-4e6fb5282f9b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.448527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-c1026291-757e-4de7-9484-251e9298d8ad req-aff6329a-a888-4078-9080-4e6fb5282f9b service nova] Creating event network-changed:8ea050fb-d23a-40db-97f4-4c903e422a1e for instance 4b480405-4306-48e6-9bca-1f90443f0bd0 on hv-cinder-86236 Nov 02 20:30:49.449328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c1026291-757e-4de7-9484-251e9298d8ad req-aff6329a-a888-4078-9080-4e6fb5282f9b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 20:30:49.449855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c1026291-757e-4de7-9484-251e9298d8ad req-aff6329a-a888-4078-9080-4e6fb5282f9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 20:30:49.451548 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.452140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.452651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.454380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.454824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.455240 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.463875 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.compute.rpcapi [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 20:30:49.464782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] Releasing lock "compute-rpcapi-router" {{(pid=118985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 20:30:49.481069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-154fd255-3286-4d47-b2af-a2a7bf5c0be3 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125954 Nov 02 20:30:49.481677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 28/58] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:49.547778 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:49.555502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5ed89067-b2ad-4774-9a08-2aa4a88f8dd7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.151948 Nov 02 20:30:49.556115 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:49 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:49.618099 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:49.618814 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:49.625080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.625564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.626002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.626694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.627151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.627578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.766400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:49.773942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0c3e68ab-951b-4c24-8256-7fe4335dc897 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.160195 Nov 02 20:30:49.774500 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 29/60] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:49 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:49.794170 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:49.795449 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:49.801329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.801834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.802262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.802968 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.803421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.803870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.886434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:49.887056 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:49.893309 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.893851 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.894234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.894932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:49.895394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:49.895855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:49.933809 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:49.942053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-58f64db3-451e-451f-9c7d-42e5ecb39a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.151603 Nov 02 20:30:49.942641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 32/61] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:49 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:49.956984 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:49.964991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:49.966429 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:49.968316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-77bc58e6-5c46-422d-bc29-87924be88160 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1286 microversion: 2.20 time: 0.085768 Nov 02 20:30:49.968868 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 30/62] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:49 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:30:50.013635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:50.014985 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:50.020902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.021381 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.021816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.022502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.022958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.023413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.042346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:50.151679 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:50.159383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f0044f11-1cc4-4369-a7ba-a6430dcca2cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.149729 Nov 02 20:30:50.159976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:50 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:50.579102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:50.579657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:50.585539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.586008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.586426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.587140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.587589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.588030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.720766 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:50.729418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dbb8e9dc-7868-46ed-8a27-35399ca6fbdb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.154858 Nov 02 20:30:50.732458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 31/64] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:50 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:50.797281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:50.798283 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:50.804052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.804532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.804958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.805638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.806092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.806511 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.936399 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:50.943947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ccd34a83-f1e1-4c0e-a06e-2a1cb40b68b6 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.151022 Nov 02 20:30:50.944519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 34/65] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:50 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:50.964899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:50.965553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:50.972298 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.972817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.973268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.974048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:50.974518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:50.974996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:50.993216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:50.993818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:50.996681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:51.000482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.000961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.001390 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:51.002072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.002519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.002934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:51.116215 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:51.124727 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f48b1a2d-cd01-4928-9d4b-be6e040032ac tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.163843 Nov 02 20:30:51.131740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 32/66] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:50 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:51.182643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:51.183203 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:51.190145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.191020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.191705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:51.192660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.193343 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.193989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:51.266409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:51.277586 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:51.279047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:51.281775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e5aade62-f5dc-4a2e-8c21-30aaac40addc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1286 microversion: 2.20 time: 0.292251 Nov 02 20:30:51.284943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 35/67] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:50 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1286 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:30:51.356856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:51.365036 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d91fedbc-8eed-44cd-b9e0-f836dce0174f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.186512 Nov 02 20:30:51.365911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 33/68] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:51 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:51.753019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:51.753608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:51.761782 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.762576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.763230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:51.764178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.764992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.765662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:51.921512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:51.929638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c04e5028-5340-4381-8e31-337c74124b78 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.180407 Nov 02 20:30:51.930983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:51 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:51.966827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:51.967437 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:51.973826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.974471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.975033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:51.975947 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:51.976474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:51.976964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.132068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:52.145272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d443ef2e-d503-49e1-a570-13f9ae8687c3 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.182297 Nov 02 20:30:52.146388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 34/70] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:51 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:52.149161 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:52.149934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:52.165939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.166520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.167022 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.172140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.172821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.173394 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.310260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:52.312396 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:52.331823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.332672 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.333269 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.334146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.339905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.347564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:52.352448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.358253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d7f6308e-e8ed-42c6-bc29-e6c749d374ef tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.212301 Nov 02 20:30:52.372091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 37/71] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:52 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:52.393078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:52.393698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:52.400058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.400589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.401099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.401811 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.402286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.403601 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.429855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:52.440686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:52.442542 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:52.444134 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2f3987ba-39a1-4cc2-b704-8adaea085993 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1286 microversion: 2.20 time: 0.138326 Nov 02 20:30:52.456155 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 35/72] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:52 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:30:52.555147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:52.564431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-78ed4f73-1f92-419d-80a9-f07aa3a830f0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.179428 Nov 02 20:30:52.566070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 38/73] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:52 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:52.952725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:52.953583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:52.960396 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.960884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.961313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:52.962193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:52.962645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:52.963065 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.176933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:53.177897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:53.192410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.193919 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.195553 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.197786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.199395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.205221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.228779 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:53.236979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:53.240286 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fbb2c0a6-1dd8-43dd-93c9-cb585d3d05dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.292544 Nov 02 20:30:53.241628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 36/74] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:52 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:53.383888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:53.384828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:53.394178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.402513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.403645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.406812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.408382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.409875 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.546221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:53.569059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-da0cc5a9-a79b-438b-ac7e-e3df0492d7b9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.401377 Nov 02 20:30:53.585628 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 39/75] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:53 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:53.597982 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:53.602846 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:53.618659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.620091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.620687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.621768 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.622376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.623658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.684589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:53.705604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-050d152d-dc7e-4beb-9dc8-ba166a4636d3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.326865 Nov 02 20:30:53.717294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 37/76] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:53 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:53.723102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:53.723555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:53.735593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.737160 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.742939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.744367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:53.750487 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:53.753390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:53.754031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:53.763110 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:53.765280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:53.766427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-584cca47-c57d-40c1-a115-a3171e725c87 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1286 microversion: 2.20 time: 0.179570 Nov 02 20:30:53.766988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 40/77] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:53 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:30:53.934795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:53.943698 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-01f8458e-47db-4ad0-8a09-96bf4ccb1a02 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.230459 Nov 02 20:30:53.955823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 38/78] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:53 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:54.266692 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:54.267326 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:54.273676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.274184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.274592 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:54.275295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.275948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.276376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:54.475781 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:54.487130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8355ff60-bfa2-4227-bf70-a85a667cb22d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.224276 Nov 02 20:30:54.488409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 41/79] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:54 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:30:54.599027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:54.600334 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:54.608603 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.609443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.610287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:54.611678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.612769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.613385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:54.740801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:54.741952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:54.761658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.762307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.764344 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:54.765847 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.766489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.768026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:54.944867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:54.957853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-da2c479b-e988-444b-9ccb-2fd6a35b8e83 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.362600 Nov 02 20:30:54.958624 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 39/80] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:54 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:54.965536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:54.967982 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:54.985794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.986508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.987379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:54.988425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:54.989462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:54.990107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:55.094839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:55.108870 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:55.110433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:55.111559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-95fa1811-146a-43df-a47b-c2c3104153e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1286 microversion: 2.20 time: 0.151629 Nov 02 20:30:55.112137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 40/81] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:54 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:30:55.117407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:55.118513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:55.136211 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:55.136925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:55.137513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:55.138887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:55.139511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:55.140146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:55.149541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:55.161612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f5164305-9922-478d-bfe6-b6387c300d1a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.425924 Nov 02 20:30:55.162757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 42/82] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:54 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:55.424072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:55.443857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-33db4562-3eec-43d8-b16b-03b439d04c89 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.330329 Nov 02 20:30:55.460479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 41/83] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:55 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:55.516867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:55.517730 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:55.528351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:55.529679 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:55.532690 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:55.536477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:55.538222 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:55.540434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:55.752181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:55.765307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-107d219b-ed20-4f4b-b6b0-5d1eb394237b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.253592 Nov 02 20:30:55.765889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 43/84] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:55 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:55.985785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:55.987333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:55.994125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:55.994854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:55.995461 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:55.997002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:55.998386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:55.998967 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.139760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:56.140775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:56.146901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.147563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.148184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.149038 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.149767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.150343 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.172217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:56.182558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b78e4f99-8975-4bb5-af64-02dce975e2b2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.201383 Nov 02 20:30:56.183158 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 42/85] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:55 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:56.188720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:56.189483 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:56.195712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.196430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.197183 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.198201 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.198672 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.199093 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.237944 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:56.249084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:56.250656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:56.252190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9e07e4ff-94ea-4fce-bc2e-bc3c68061878 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1286 microversion: 2.20 time: 0.117277 Nov 02 20:30:56.252922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 44/86] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:56 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:30:56.339476 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:56.347448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e4ab7fb8-cade-4a5d-821e-3d3a009cb1cd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.162668 Nov 02 20:30:56.348045 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 43/87] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:56 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:56.475927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:56.476685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:56.485650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.486337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.487278 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.489261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.490062 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.490832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.646881 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:56.658510 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4a05e432-5779-4f4b-9ba2-fde41b8637d5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.186407 Nov 02 20:30:56.659451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 45/88] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:56 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:56.787651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:56.788472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:56.794297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.794872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.795687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.796384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:56.796833 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:56.797416 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:56.935522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:56.949927 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-beadb212-4fe9-4301-b22e-4ccedc137262 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.165926 Nov 02 20:30:56.950540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:56 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:57.206862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:57.207592 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:57.213783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.214391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.214945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:57.215760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.216653 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.217741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:57.291907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:57.292834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:57.304821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.306207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.307088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:57.308700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.313980 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.314671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:57.448898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:57.458813 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:57.469661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:57.471328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-27fb13ca-474f-4b10-876e-34e14af755a3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1286 microversion: 2.20 time: 0.192518 Nov 02 20:30:57.472394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 45/90] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:57 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:30:57.499562 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:57.503819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:57.511885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.513040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.513733 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:57.514849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.515459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.516052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:57.845096 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:57.856528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ba644a05-679f-4341-85c7-af50485bc5ba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.653988 Nov 02 20:30:57.857985 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 46/91] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:57 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:57.863446 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:57.864339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:57.873341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.874140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.874798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:57.875748 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:57.876410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:57.877055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:58.073147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:58.127372 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:58.262203 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:58.275805 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f162c8dc-5b5e-49db-9d4d-c45e6496a71a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.801508 Nov 02 20:30:58.301881 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 46/92] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:57 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:58.333200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:58.335460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:58.359349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:58.360263 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:58.361215 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:58.362630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:58.363468 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:58.364101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:58.381341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:58.394177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-88bcbc91-1aa5-461b-877c-dbd3efcc6aab tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.534713 Nov 02 20:30:58.395087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 47/93] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:57 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:58.502324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:58.503307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:58.510211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:58.511054 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:58.511889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:58.513423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:58.514079 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:58.515484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:58.849565 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:58.961775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:58.973087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:58.974539 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:58.975682 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-843247c6-eade-4431-84c5-296618a4a0a5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1334 microversion: 2.20 time: 0.478031 Nov 02 20:30:58.976397 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 48/94] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:30:58 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1334 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:30:58.984423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:59.001125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-01dea0b3-b2c8-4ddb-a013-32dfe9545721 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.685347 Nov 02 20:30:59.001729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 47/95] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:58 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:59.004092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:59.005071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:59.014503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:59.015368 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:59.016112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:59.018024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:59.018813 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:59.019688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:59.304694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:59.305637 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:59.312404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:59.313049 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:59.314331 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:59.315213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:59.316303 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:59.316733 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:59.435297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:59.446402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4337a087-e7e5-48b7-8573-9ad97450adfb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.468714 Nov 02 20:30:59.447161 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 49/96] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:58 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:59.457669 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:30:59.458632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:30:59.464370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=8 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:59.470515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:59.471010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:59.471467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:59.472169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:59.472713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:59.473205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:59.478047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:59.634400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:59.655161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cdb2861d-611c-419f-bfb8-abc93931ca1b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.349770 Nov 02 20:30:59.658283 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 48/97] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:59 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:30:59.670671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-7887b795-df71-4b0b-9c2f-5024d33e45b0 req-870ecf2b-616e-4838-860a-1caaae244726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9283ec9e-c3c6-4e56-a927-21452503230f", "tag": "372a875a-1d32-4fab-896d-2a33843a0aae"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:30:59.704673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7887b795-df71-4b0b-9c2f-5024d33e45b0 req-870ecf2b-616e-4838-860a-1caaae244726 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:30:59.705019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7887b795-df71-4b0b-9c2f-5024d33e45b0 req-870ecf2b-616e-4838-860a-1caaae244726 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:30:59.705450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7887b795-df71-4b0b-9c2f-5024d33e45b0 req-870ecf2b-616e-4838-860a-1caaae244726 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:30:59.738849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-7887b795-df71-4b0b-9c2f-5024d33e45b0 req-870ecf2b-616e-4838-860a-1caaae244726 service nova] Creating event network-changed:372a875a-1d32-4fab-896d-2a33843a0aae for instance 9283ec9e-c3c6-4e56-a927-21452503230f on hv-cinder-86236 Nov 02 20:30:59.748281 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-7887b795-df71-4b0b-9c2f-5024d33e45b0 req-870ecf2b-616e-4838-860a-1caaae244726 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088622 Nov 02 20:30:59.749238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 49/98] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:30:59.947367 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:30:59.957898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-53246695-06da-4cfa-a81e-f8b3781fa5e3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.509002 Nov 02 20:30:59.977150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 50/99] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:30:59 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:00.009124 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:00.009935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:00.021934 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.025308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.026251 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.028121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.030972 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.031122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:00.031761 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:00.032415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.049644 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.050268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.052286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.052823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.054643 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.056706 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.232608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:00.242057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:00.243764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:00.245073 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1eac9f5d-0ba8-4e5e-94a0-f9d23d7fdb7d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1340 microversion: 2.20 time: 0.241128 Nov 02 20:31:00.246344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 50/100] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:00 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1340 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:00.320199 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:00.333929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c4f45ef8-eaf5-4f71-8f0d-e3484f4fdeb3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.312519 Nov 02 20:31:00.336458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:00 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:00.363096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-28cd385a-4199-49cd-8b53-cb2247273638 req-aacae4e0-9f37-4416-8b10-bc956e02944f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8374bf3-0545-49a4-9acb-3616953c493f", "tag": "8b5041b6-2926-4755-abf3-f108f1b4031d"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:00.373943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-28cd385a-4199-49cd-8b53-cb2247273638 req-aacae4e0-9f37-4416-8b10-bc956e02944f service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.374522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-28cd385a-4199-49cd-8b53-cb2247273638 req-aacae4e0-9f37-4416-8b10-bc956e02944f service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.375026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-28cd385a-4199-49cd-8b53-cb2247273638 req-aacae4e0-9f37-4416-8b10-bc956e02944f service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.388898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-28cd385a-4199-49cd-8b53-cb2247273638 req-aacae4e0-9f37-4416-8b10-bc956e02944f service nova] Creating event network-changed:8b5041b6-2926-4755-abf3-f108f1b4031d for instance a8374bf3-0545-49a4-9acb-3616953c493f on hv-cinder-86236 Nov 02 20:31:00.394118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-28cd385a-4199-49cd-8b53-cb2247273638 req-aacae4e0-9f37-4416-8b10-bc956e02944f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139968 Nov 02 20:31:00.394984 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 51/102] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:00.473202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:00.473817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:00.479846 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.480327 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.480753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.481463 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.482889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.483317 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.631939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:00.640368 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3b8e5289-8980-4009-a77c-bf86eaaba966 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.172169 Nov 02 20:31:00.640943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 52/103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:00 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:00.689497 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:00.690361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:00.696648 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.697248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.697693 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.698388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.698849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.699278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.983851 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:00.985198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:00.993841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.994465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.995362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:00.996099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:00.996751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:00.998333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:01.044536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:01.053121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b0ff5eec-c2f9-4bcc-841e-7786d37ab100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.369474 Nov 02 20:31:01.088819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 52/104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:00 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:01.157188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:01.165139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9c6e65d8-27f9-47de-990d-5cc3287c4d4c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.186188 Nov 02 20:31:01.165689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 53/105] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:00 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:01.270633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:01.271329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:01.277275 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:01.278124 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:01.278520 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:01.279738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:01.280255 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:01.280969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:01.346213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:01.355579 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:01.357665 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:01.358949 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:01.359059 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-338bf129-3dda-4a89-8107-0eecf2b4bee3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1340 microversion: 2.20 time: 0.091961 Nov 02 20:31:01.359504 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 53/106] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:01 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:01.359707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:01.367184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:01.368013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:01.368853 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:01.369542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:01.370172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:01.370868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:01.519404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:01.530070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b60e8617-27a0-49a9-a09c-98b05b751e91 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.175529 Nov 02 20:31:01.530651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 54/107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:01 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:01.664497 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:01.665686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:01.672772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:01.673266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:01.673702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:01.674399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:01.674856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:01.675439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:01.830600 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:01.834085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:01.840221 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-865d011f-f019-4b72-a86c-91eac889eeba tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.179569 Nov 02 20:31:01.841159 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 54/108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:01 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:02.084376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:02.085148 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:02.091905 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.092458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.092991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.093909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.094552 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.095180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.194218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:02.195830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:02.203456 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.204043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.204703 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.205308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.205773 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.206204 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.267650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:02.278155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-83d69bc6-1d4f-4a7d-aa86-2e77d9c048f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.198909 Nov 02 20:31:02.279467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 55/109] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:02 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:02.360006 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:02.371516 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-09c6af67-9459-4cd5-b03b-a84fb5a3f51d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.179709 Nov 02 20:31:02.371516 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 55/110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:02 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:02.386328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:02.386937 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:02.394733 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.395224 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.396216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.396416 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.396870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.397290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.423459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-7d4c8b72-85e6-4f5a-93c0-61db9a3f51ec req-1d02770e-405a-405a-9fdc-84c65fcb6db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "738d7da5-411f-449b-82cd-ad465b7d559b", "tag": "1c24d96e-aa0a-461b-a216-ded8e5906519"}, {"name": "network-changed", "server_uuid": "80aa0a2a-951c-4113-b7df-d2d32b966e13", "tag": "4b802a9e-a37f-4aa5-82ec-1e14deba17d6"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:02.460834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7d4c8b72-85e6-4f5a-93c0-61db9a3f51ec req-1d02770e-405a-405a-9fdc-84c65fcb6db5 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.461995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7d4c8b72-85e6-4f5a-93c0-61db9a3f51ec req-1d02770e-405a-405a-9fdc-84c65fcb6db5 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.463503 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7d4c8b72-85e6-4f5a-93c0-61db9a3f51ec req-1d02770e-405a-405a-9fdc-84c65fcb6db5 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.506435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-7d4c8b72-85e6-4f5a-93c0-61db9a3f51ec req-1d02770e-405a-405a-9fdc-84c65fcb6db5 service nova] Creating event network-changed:1c24d96e-aa0a-461b-a216-ded8e5906519 for instance 738d7da5-411f-449b-82cd-ad465b7d559b on hv-cinder-86236 Nov 02 20:31:02.507096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-7d4c8b72-85e6-4f5a-93c0-61db9a3f51ec req-1d02770e-405a-405a-9fdc-84c65fcb6db5 service nova] Creating event network-changed:4b802a9e-a37f-4aa5-82ec-1e14deba17d6 for instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 on hv-cinder-86236 Nov 02 20:31:02.515166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-7d4c8b72-85e6-4f5a-93c0-61db9a3f51ec req-1d02770e-405a-405a-9fdc-84c65fcb6db5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099984 Nov 02 20:31:02.531072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 56/111] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:02.553976 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:02.554700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:02.564793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.565273 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.566129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.568501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.570037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.571553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.624205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:02.633783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:02.643983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:02.643983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-56a2835d-61c6-4dd6-ad8a-d8636adbe446 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1340 microversion: 2.20 time: 0.260606 Nov 02 20:31:02.643983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 56/112] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:02 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1340 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:02.866898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:02.867519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:02.879091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.879581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.880032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.888881 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:02.891121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:02.891563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:02.916359 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:02.933658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0b3985b3-0d83-4572-8440-90ceb704baf6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.382615 Nov 02 20:31:02.936112 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 57/113] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:02 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:03.307986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:03.309294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:03.325010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.325519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.326027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:03.326750 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.327212 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.327827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:03.388941 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:03.398476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-44a3841c-6b35-49c8-8392-0362ad810c28 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.535921 Nov 02 20:31:03.400700 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 57/114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:02 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:03.423873 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:03.424830 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:03.433779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.435032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.436356 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:03.438188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.440330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.441380 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:03.549235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:03.563467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a3534174-b347-4553-ace7-1384737d4bd9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.258325 Nov 02 20:31:03.576898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 58/115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:03 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:03.668999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:03.670720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:03.679825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.681084 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.681801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:03.683034 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.683699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.684669 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:03.780330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:03.788958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f5bb5597-faa3-480d-896d-e471ae26caba tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.378633 Nov 02 20:31:03.803653 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 58/116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:03 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:03.803975 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:03.824218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:03.826432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:03.827667 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-986186aa-d3bc-4ec9-8c12-c730ee40c708 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1340 microversion: 2.20 time: 0.164034 Nov 02 20:31:03.828547 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 59/117] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:03 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1340 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:03.959224 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:03.959908 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:03.966877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.967748 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.968190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:03.968895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:03.969350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:03.969825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.170128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:04.186272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b8516011-dae5-46e3-a3a6-fac688285868 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.230479 Nov 02 20:31:04.186574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 59/118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:03 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:04.427366 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:04.430369 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:04.438630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.439118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.439746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.440450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.440910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.441371 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.581744 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:04.588157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:04.588761 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:04.589528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-93f58ac1-efb8-4d46-b918-76efec9eef56 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.167572 Nov 02 20:31:04.590108 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 60/119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:04 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:04.594927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.595399 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.595862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.596546 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.597083 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.597499 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.737595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:04.745289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5c48fde0-3e81-417a-b30e-c67a243aebdf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.161064 Nov 02 20:31:04.745911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 60/120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:04 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:04.816478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:04.817174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:04.823193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.823829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.824339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.825109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.825639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.826841 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.852687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:04.853476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:04.860124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.860685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.861714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.862617 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:04.863347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:04.864032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:04.970161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:04.982954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d92bc3da-d3d6-4aa6-b75b-cde9df9393cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.169423 Nov 02 20:31:04.983633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 61/121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:04 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:05.025534 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:05.034986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:05.036465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:05.037697 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c10758ae-4c58-4c36-aea0-af50d197e175 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.188724 Nov 02 20:31:05.038754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 61/122] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:04 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:05.211253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:05.211793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:05.218108 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:05.218594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:05.219118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:05.219780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:05.220266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:05.220764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:05.350355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:05.358780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-18378c55-6050-4c69-8f6a-a03df100aa41 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.151640 Nov 02 20:31:05.359354 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 62/123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:05 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:05.612522 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:05.613156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:05.618819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:05.619301 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:05.619760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:05.620440 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:05.620884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:05.621295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:05.755751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:05.764126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2521fdf1-b138-45b8-bf85-91342700dd92 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.154807 Nov 02 20:31:05.764694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 62/124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:05 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:05.769268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:05.770058 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:05.776218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:05.776907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:05.777539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:05.778348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:05.778984 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:05.780068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:05.913306 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:05.922105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8aa75944-ee7a-4c6b-a934-30fea7c2b6c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.157666 Nov 02 20:31:05.922780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 63/125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:05 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:06.010228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:06.010827 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:06.017892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.018594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.019125 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.019931 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.020478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.021004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.064227 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:06.065116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:06.072880 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.073602 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.074232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.074939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.075414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.075917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.187147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:06.197808 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9d9f302b-dce7-4f9c-ac2c-005d96ede5da tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.191328 Nov 02 20:31:06.198384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 63/126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:06 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:06.216248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:06.225599 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:06.239862 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:06.240933 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-89e6ba16-dd75-4206-97d8-2b9ad453d301 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.182378 Nov 02 20:31:06.241498 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 64/127] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:06 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:06.381727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:06.382328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:06.388291 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.388780 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.389187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.389856 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.390298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.390710 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.522249 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:06.530215 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-03881f9a-3a72-49b5-85d6-bb119f218eed tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.152362 Nov 02 20:31:06.530771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 64/128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:06 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:06.787758 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:06.788296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:06.794244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.794813 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.795278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.796239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.796686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.797106 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.938824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:06.946812 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:06.947264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f5670109-7943-4605-9cc4-559433de000a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.163929 Nov 02 20:31:06.947721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:06.947884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 65/129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:06 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:06.955587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.956519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.956950 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:06.957654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:06.958108 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:06.958529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.221068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:07.221676 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:07.227796 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.228282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.228718 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.229412 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.229899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.230322 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.344770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:07.354065 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-340f5287-5ce9-4c93-bf61-3963d92d5866 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.411338 Nov 02 20:31:07.364398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 65/130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:06 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:07.369217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:07.376481 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:07.377090 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:07.378708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bfae69cb-2119-44a5-9a0a-e8318ed466e0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.161417 Nov 02 20:31:07.379282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 66/131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:07 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:07.382922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.383398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.383867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.384726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.385210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.385628 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.553418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:07.554027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:07.560323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.560752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.561187 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.561883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.562469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.562965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.592913 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:07.600522 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:07.607645 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:07.609128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:07.610247 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-968c2968-278f-4d02-a27b-d7e396ccf473 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.244602 Nov 02 20:31:07.611662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 66/132] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:07 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:07.711143 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:07.720014 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5a5bb799-253d-40e3-bd51-38e8ebcf30ef tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.170497 Nov 02 20:31:07.720760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 67/133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:07 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:07.944429 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-2efcf91c-f569-4dd8-ad27-03d58dbe930b req-ad050eac-3b4a-4510-a377-b4baa2c98e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6257b48a-e22b-448d-a9be-458c3c9517c9", "tag": "0abd5e39-f20b-413e-b780-db9205640fd2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:07.956761 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2efcf91c-f569-4dd8-ad27-03d58dbe930b req-ad050eac-3b4a-4510-a377-b4baa2c98e28 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.957235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2efcf91c-f569-4dd8-ad27-03d58dbe930b req-ad050eac-3b4a-4510-a377-b4baa2c98e28 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.957658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2efcf91c-f569-4dd8-ad27-03d58dbe930b req-ad050eac-3b4a-4510-a377-b4baa2c98e28 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.971637 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:07.972373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:07.977442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-2efcf91c-f569-4dd8-ad27-03d58dbe930b req-ad050eac-3b4a-4510-a377-b4baa2c98e28 service nova] Creating event network-changed:0abd5e39-f20b-413e-b780-db9205640fd2 for instance 6257b48a-e22b-448d-a9be-458c3c9517c9 on hv-cinder-86236 Nov 02 20:31:07.977990 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2efcf91c-f569-4dd8-ad27-03d58dbe930b req-ad050eac-3b4a-4510-a377-b4baa2c98e28 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118986) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 20:31:07.978343 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2efcf91c-f569-4dd8-ad27-03d58dbe930b req-ad050eac-3b4a-4510-a377-b4baa2c98e28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118986) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 20:31:07.978737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.979228 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.979683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.979791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.980225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.980385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.980647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.981000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.981349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:07.981584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.981792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:07.982806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:07.992577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.compute.rpcapi [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 20:31:07.993458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] Releasing lock "compute-rpcapi-router" {{(pid=118986) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 20:31:08.010533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6298cdc9-f44a-4b92-9657-5382bb09bc9a None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069664 Nov 02 20:31:08.014725 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 67/134] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:31:08.113183 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:08.121165 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5b85b8d9-beaf-4833-ac48-1690455468e8 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.153680 Nov 02 20:31:08.121826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 68/135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:07 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:08.381916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:08.382612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:08.389676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.390232 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.390732 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.391509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.391995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.392413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.403986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:08.404593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:08.410558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.411040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.411470 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.412178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.412786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.413351 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.532911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:08.540466 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-78f31073-1644-4c80-bad9-534a6623e8ea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.162778 Nov 02 20:31:08.541036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 68/136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:08 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:08.543372 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:08.551311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d790e267-acf5-4106-8f66-8b0c1bf5f7a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.151327 Nov 02 20:31:08.552233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 69/137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:08 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:08.634779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:08.635376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:08.641373 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.641841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.642271 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.642943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.643387 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.643834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.743265 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:08.744022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:08.750053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.750531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.750974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.751673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:08.752129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:08.752547 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:08.775764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:08.784616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:08.786050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:08.787148 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a5f30fa5-3515-4401-a352-e5f8f9eef164 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.156303 Nov 02 20:31:08.787736 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 69/138] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:08 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:08.883301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:08.891914 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-33b8de1d-8359-4280-af56-018165f5edc1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.152687 Nov 02 20:31:08.892732 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 70/139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:08 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:09.144562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:09.145101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:09.151078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.151552 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.152019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.152748 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.153194 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.153610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.283048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:09.290541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-483298e5-b3d8-46df-9e4a-8498c254ac5e tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.149837 Nov 02 20:31:09.291104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 70/140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:09 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:09.565110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:09.566134 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:09.576735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:09.577213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:09.577626 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:09.579220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.580050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.580804 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.581830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.582482 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.583389 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.583647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.584120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.584698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.585670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.586519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.586996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.803430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:09.813198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cafce643-1671-4181-aa1d-09664ae5dade tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.253109 Nov 02 20:31:09.813778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 71/141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:09 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:09.818644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:09.819247 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:09.824990 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.825469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.826217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.826918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.827366 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.827979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.832580 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:09.843852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:09.854258 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b8823fc1-63f9-47cb-ac42-fa0ae9f57ae2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.281954 Nov 02 20:31:09.855044 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 71/142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:09 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:09.916000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:09.916681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:09.935947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.936455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.936964 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:09.937722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:09.938943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:09.939377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:10.010801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:10.023274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:10.025045 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:10.026292 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-67333dda-8a97-4eab-9846-e3badef65e58 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.211353 Nov 02 20:31:10.026951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 72/143] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:09 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:10.087936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:10.095948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-76ed2ab4-3a69-4995-aaa5-77f955c58cf7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.184214 Nov 02 20:31:10.096512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 72/144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:09 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:10.314755 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:10.315358 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:10.321230 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:10.321703 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:10.322129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:10.322806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:10.323253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:10.323699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:10.455902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:10.464071 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1586508f-ac0e-4c72-b75b-bd46df89a187 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.153075 Nov 02 20:31:10.464642 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 73/145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:10 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:10.835693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:10.836388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:10.843046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:10.843663 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:10.844247 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:10.845056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:10.845580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:10.846073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:10.878956 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:10.880051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:10.886224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:10.886823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:10.887332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:10.888760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:10.893991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:10.894833 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:10.991208 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:11.000855 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-15d1a312-a63a-4817-b97e-c32ed379bb74 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.168979 Nov 02 20:31:11.001827 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 73/146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:10 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:11.046649 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:11.052649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:11.053937 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:11.057107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0e29935c-1cbe-4335-ad8e-dd37cdb9815d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.181734 Nov 02 20:31:11.058168 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 74/147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:10 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:11.062184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:11.063718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:11.065195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:11.066196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:11.066934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:11.067547 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:11.118222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:11.118826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:11.125140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:11.125635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:11.126078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:11.126774 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:11.127233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:11.127673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:11.231670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:11.242014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:11.243910 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:11.245296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9131b979-9853-452a-a642-130789f4b409 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.197024 Nov 02 20:31:11.257044 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 74/148] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:11 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:11.296062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:11.304080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ac2133df-1769-4111-a19e-549f1888267f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.189571 Nov 02 20:31:11.304655 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 75/149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:11 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:11.488589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:11.489202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:11.495149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:11.495681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:11.496125 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:11.496821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:11.498211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:11.499039 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:11.644866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:11.652708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4cea91d9-a3d6-40ef-9a8a-59110cee3a54 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.169371 Nov 02 20:31:11.653287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 75/150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:11 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:12.025438 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:12.026051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:12.032422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.032910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.033343 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.034029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.034485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.034906 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.083060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:12.083756 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:12.090063 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.090650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.091162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.092141 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.092823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.093409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.177687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:12.197420 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-65962054-f975-4276-bce1-61aa4ad6354e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.175683 Nov 02 20:31:12.198031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 76/151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:12 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:12.272854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:12.274104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:12.283466 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.284347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.285145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.285991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.286517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.287015 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.410642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:12.419128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b11268de-3ec6-4b7f-828f-cda1a4099bc0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.340075 Nov 02 20:31:12.419877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 76/152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:12 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:12.425253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:12.425919 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:12.431846 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.432488 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.432927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.433609 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.434341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.435478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.483817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:12.492072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:12.493644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:12.494746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d45e01bc-373a-46d7-92aa-9a99261b95af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.226176 Nov 02 20:31:12.499222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 77/153] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:12 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:12.569089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:12.579767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d13978a4-8159-4b8f-b65a-8d2c7ca8e787 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.158625 Nov 02 20:31:12.580340 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 77/154] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:12 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:12.675229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:12.675888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:12.681689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.682169 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.682596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.683273 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:12.683764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:12.684442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:12.820589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:12.829359 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-81850f78-993f-40fd-b343-be75f27ae820 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.158365 Nov 02 20:31:12.829932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 78/155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:12 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:13.221312 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:13.221927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:13.227916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.228396 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.228826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.229502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.229950 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.230369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.359377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:13.367470 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9bd54d43-9cd3-498f-9bfd-fd93f5b4e130 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.150036 Nov 02 20:31:13.368074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 78/156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:13 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:13.442596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:13.443206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:13.449383 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.449867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.450300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.451572 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.452080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.452627 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.524046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:13.524651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:13.530945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.531431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.532059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.532848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.533997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.534442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.586225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:13.599681 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-83bb731d-886e-4cf2-be1d-03cd6f5cd548 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.160865 Nov 02 20:31:13.600654 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 79/157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:13 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:13.606360 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:13.607818 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:13.614712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.615415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.615936 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.616780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.617392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.617815 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.683268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:13.693600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:13.695054 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:13.696217 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e42f843c-d2dc-4876-b1a9-c095e1652064 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.176536 Nov 02 20:31:13.696776 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 79/158] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:13 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:13.751410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:13.759151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3d5a1568-38ea-44c6-8025-a6713754ad63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.157362 Nov 02 20:31:13.759873 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 80/159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:13 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:13.852775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:13.853311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:13.859938 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.860418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.860852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.861536 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:13.861990 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:13.862411 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:13.994149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:14.002188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0c82a304-b74f-4025-a038-a7b585e9a84f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.153248 Nov 02 20:31:14.002749 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 80/160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:13 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:14.391496 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:14.392151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:14.398045 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.398523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.398953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.399652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.400108 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.400529 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.530799 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:14.538376 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-74498052-95c2-49d0-82e2-9e0c95419a2d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.151422 Nov 02 20:31:14.538953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 81/161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:14 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:14.624672 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:14.625282 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:14.631278 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.631794 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.632231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.632912 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.633366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.633790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.721124 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:14.721811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:14.727954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.728857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.728983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.729967 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.730404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.730898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.766759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:14.774471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1eae60b2-ecb5-4254-ad97-d0f83990bec3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.154425 Nov 02 20:31:14.775051 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:14 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:14.781581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:14.782312 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:14.788188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.788837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.790100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.790100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:14.790663 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:14.791090 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:14.860363 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:14.868663 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:14.870171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:14.871314 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c50c2d48-c0a8-46e2-875e-522a80a6a850 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.154098 Nov 02 20:31:14.871907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 82/163] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:14 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:14.920049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:14.927863 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4a8da45c-c417-4094-8628-ef2bc374a41e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.149944 Nov 02 20:31:14.928434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 82/164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:14 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:15.024121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:15.024724 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:15.030575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.031018 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.031449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:15.032149 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.032598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.033015 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:15.165399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:15.173382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7383730c-c6ba-48b5-91c9-d6d1d467b604 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.153415 Nov 02 20:31:15.173948 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 83/165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:15 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:15.560710 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:15.561313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:15.567068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.567546 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.568145 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:15.568820 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.569265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.569677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:15.695952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:15.699577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:15.705169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4c87aa9b-7991-4e9a-9f98-b9c262329442 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.148598 Nov 02 20:31:15.705742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 83/166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:15 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:15.798448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:15.799057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:15.805043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.805522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.805956 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:15.806635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.807086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.807505 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:15.911686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:15.912595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:15.918688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.919180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.920048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:15.932363 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:15.932847 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:15.933286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:16.041327 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:16.050321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e7851b0f-b19a-42a8-85e2-ba18dc2b3abb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.256290 Nov 02 20:31:16.051066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 84/167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:15 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:16.055545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:16.056181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:16.064951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:16.064951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:16.064951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:16.064951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:16.065388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:16.065388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:16.323710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:16.332795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f85a4a9e-e916-467e-a58f-49422ada56fb tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.280601 Nov 02 20:31:16.337104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 85/168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:16 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:16.344538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:16.345163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:16.359211 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:16.359730 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:16.360162 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:16.360862 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:16.361316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:16.361735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:16.508823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:16.519244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a6732164-ba01-4f5e-ab2c-2684e88a47f4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.181007 Nov 02 20:31:16.520052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 86/169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:16 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:16.585293 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:16.593970 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:16.595434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:16.596578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-155e3f95-bdff-4d94-a6d8-babfe635cf93 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.701439 Nov 02 20:31:16.597168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 84/170] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:15 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:16.728942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:16.728942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:16.735804 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:16.736331 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:16.736767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:16.737469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:16.737925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:16.738551 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.062263 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:17.074773 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7caf8cef-5a39-4cd6-b491-8d3a9e8379bc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.350340 Nov 02 20:31:17.076605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 87/171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:16 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:17.081733 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:17.084090 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:17.094418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:17.097674 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.098589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.099392 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.100687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.101751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.102505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.243196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:17.252144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c2216b7a-b73a-4eb2-a05e-77011fd4626e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.178061 Nov 02 20:31:17.253077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 85/172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:17 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:17.358817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:17.359538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:17.367173 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.367879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.368487 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.379425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.379947 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.380381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.543699 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:17.543969 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:17.545538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:17.550266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:17.552703 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.553343 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.553906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.555035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.555649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.556211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.557706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d691964a-d9b8-46dc-9050-3634b62ef905 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.204379 Nov 02 20:31:17.558896 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 88/173] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:17 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:17.624300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:17.625256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:17.631292 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.631809 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.632248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.632920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:17.633502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:17.633917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:17.699470 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:17.707427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0c342e8b-160c-416c-b4cc-f747927397ce tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.168612 Nov 02 20:31:17.708105 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 86/174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:17 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:17.779417 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:17.787933 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:17.789557 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:17.790660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-912c0658-35d8-4621-bcdd-4e04fbe2f90f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.172248 Nov 02 20:31:17.791197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 89/175] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:17 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:18.115203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:18.115841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:18.118635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:18.123055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.123539 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.124032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.124724 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.125178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.125601 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.257582 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:18.267349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bb4e6775-cb37-489e-88ad-69e7fac1c0d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.155807 Nov 02 20:31:18.268171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 87/176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:18 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:18.278754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:18.279974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:18.286751 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.287230 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.287688 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.288507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.288962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.289383 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.427817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:18.437285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-17905c75-0f77-4c01-a9f1-89802e08fbb2 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.164516 Nov 02 20:31:18.437963 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 90/177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:18 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:18.587334 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:18.588089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:18.596188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.597072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.597761 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.598790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.599475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.600400 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.742036 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:18.746198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:18.755523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.759034 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.759372 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.760134 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.761001 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.763994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.804070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:18.817070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-76474251-d2d4-4ae7-9ca5-c5f09433177a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.238122 Nov 02 20:31:18.818341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 88/178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:18 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:18.823037 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:18.824542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:18.833244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.833963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.834603 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:18.835516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:18.836201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:18.837257 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.019281 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:19.028722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-472ebf44-25cf-4af2-ae73-31e5af74c874 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.292051 Nov 02 20:31:19.030428 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 91/179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:18 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:19.080129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:19.092300 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:19.094729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:19.096754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-38fc381c-55ad-478a-8671-ad7947fed5fd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.277169 Nov 02 20:31:19.098253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 89/180] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:18 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:19.178860 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-ae39d231-8e35-43fb-b703-f271e07450a2 req-0931736c-b284-4d1e-bc72-027b724b2849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b480405-4306-48e6-9bca-1f90443f0bd0", "name": "network-vif-plugged", "status": "completed", "tag": "8ea050fb-d23a-40db-97f4-4c903e422a1e"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:19.189926 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-ae39d231-8e35-43fb-b703-f271e07450a2 req-0931736c-b284-4d1e-bc72-027b724b2849 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:19.190482 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-ae39d231-8e35-43fb-b703-f271e07450a2 req-0931736c-b284-4d1e-bc72-027b724b2849 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:19.190987 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-ae39d231-8e35-43fb-b703-f271e07450a2 req-0931736c-b284-4d1e-bc72-027b724b2849 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.202147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-ae39d231-8e35-43fb-b703-f271e07450a2 req-0931736c-b284-4d1e-bc72-027b724b2849 service nova] Creating event network-vif-plugged:8ea050fb-d23a-40db-97f4-4c903e422a1e for instance 4b480405-4306-48e6-9bca-1f90443f0bd0 on hv-cinder-86236 Nov 02 20:31:19.207156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-ae39d231-8e35-43fb-b703-f271e07450a2 req-0931736c-b284-4d1e-bc72-027b724b2849 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175416 Nov 02 20:31:19.207852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 92/181] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:19.300483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:19.302169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:19.314109 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:19.315374 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:19.315943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.316939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:19.317604 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:19.318173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.466924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:19.467822 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:19.476835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:19.477336 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:19.477857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.478921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:19.479562 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:19.480399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.704316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:19.712884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-559dc42d-6a77-4abf-b842-6be56fac616e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.255227 Nov 02 20:31:19.713781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 93/182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:19 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:19.843246 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:19.844136 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:19.850735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:19.851225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:19.851689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.871822 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:19.874078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:19.875156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:19.887330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:19.902520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0302ce40-c550-499a-a400-4a5b0d353625 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.614840 Nov 02 20:31:19.905735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 90/183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:19 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:20.052715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:20.053402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:20.061928 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.062901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.064483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:20.065728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.066644 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.067323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:20.160878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:20.170860 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3d638187-effb-4d03-9670-12ffbdf3b1aa tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.332983 Nov 02 20:31:20.189243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 94/184] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:19 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:20.194368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:20.195241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:20.207035 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.207872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.208521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:20.209432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.210314 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.211075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:20.296289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:20.304066 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-52ad6bdc-2381-49a6-b70d-fcf132c57766 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.255592 Nov 02 20:31:20.309058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 91/185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:20 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:20.398859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:20.407266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:20.408883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:20.409986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-83fa0120-2b6c-47c3-8c23-f91c09a94421 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.219482 Nov 02 20:31:20.410542 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 95/186] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:20 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:20.745943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:20.745943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:20.751387 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.751966 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.752732 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:20.753676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.754375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.755646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:20.914219 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:20.927434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:20.928234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:20.929188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a8dc8f2e-641b-43a8-b4c0-a4324fb04e5f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.192489 Nov 02 20:31:20.933830 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 92/187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:20 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:20.937391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.937883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.938304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:20.938997 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:20.939581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:20.940238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.069718 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:21.078921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-68599089-7d89-4608-8942-3cc6c492274f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.155679 Nov 02 20:31:21.079497 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 96/188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:20 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:21.196539 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:21.197397 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:21.204524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.205008 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.207743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.209082 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.209548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.210235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.222612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-e8a60e2d-8964-4e3f-b1c0-cf717b746772 req-5a0c413f-f3d8-4ff5-9736-026f2f92b797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738d7da5-411f-449b-82cd-ad465b7d559b", "name": "network-vif-plugged", "status": "completed", "tag": "1c24d96e-aa0a-461b-a216-ded8e5906519"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:21.236046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-e8a60e2d-8964-4e3f-b1c0-cf717b746772 req-5a0c413f-f3d8-4ff5-9736-026f2f92b797 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.238657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-e8a60e2d-8964-4e3f-b1c0-cf717b746772 req-5a0c413f-f3d8-4ff5-9736-026f2f92b797 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.239272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-e8a60e2d-8964-4e3f-b1c0-cf717b746772 req-5a0c413f-f3d8-4ff5-9736-026f2f92b797 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.261647 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-e8a60e2d-8964-4e3f-b1c0-cf717b746772 req-5a0c413f-f3d8-4ff5-9736-026f2f92b797 service nova] Creating event network-vif-plugged:1c24d96e-aa0a-461b-a216-ded8e5906519 for instance 738d7da5-411f-449b-82cd-ad465b7d559b on hv-cinder-86236 Nov 02 20:31:21.268516 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-e8a60e2d-8964-4e3f-b1c0-cf717b746772 req-5a0c413f-f3d8-4ff5-9736-026f2f92b797 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049399 Nov 02 20:31:21.270092 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 97/189] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:31:21.330289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:21.331051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:21.366271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.366782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.369797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.370550 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.371021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.371454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.445257 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:21.459350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ae5282d3-eeb8-4e43-b90e-5b3e3149563d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.266812 Nov 02 20:31:21.475527 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 93/190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:21 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:21.482522 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:21.483769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:21.496353 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.497779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.498367 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.503838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.505831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.507137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.663674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:21.672503 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8dd721ab-3a4e-4674-bd99-9758a11c737d tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.347646 Nov 02 20:31:21.673722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 98/191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:21 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:21.706728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:21.718060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:21.721085 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:21.731437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c5eb6ee1-b413-47d4-bba8-fd9371a25c64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.253543 Nov 02 20:31:21.732943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 94/192] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:21 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:21.952267 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:21.953032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:21.962677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.963751 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.964195 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:21.965004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:21.968133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:21.970554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.104774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:22.105726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:22.118964 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.120175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.121729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.125270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.125891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.126408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.211633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:22.220661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4fa43d8f-0e37-4d9d-a986-a5016fb6a1fe tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.272815 Nov 02 20:31:22.221706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 99/193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:21 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:22.371283 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:22.386321 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a1ee051f-c414-4059-adb9-5aa6741d9bb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.287988 Nov 02 20:31:22.387081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 95/194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:22 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:22.483151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:22.483965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:22.497856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.503601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.503932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.504816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.505289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.510367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.698346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:22.698958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:22.708620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.712455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.713093 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.717500 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.718413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.720099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.799662 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:22.811388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0142c7a8-f3d7-45fa-875f-246036eee1af tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.332298 Nov 02 20:31:22.812314 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 100/195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:22 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:22.819232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:22.819911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:22.829423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.830078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.830731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:22.831697 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:22.832434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:22.833103 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:23.018121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:23.028086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8377c71a-74f6-4905-86d8-2b3750bdd7d9 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.334188 Nov 02 20:31:23.029851 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 96/196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:22 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:23.117969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:23.135717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:23.137307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:23.138653 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-21ed06b8-d190-44d0-a846-993961db04d9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.325035 Nov 02 20:31:23.152345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 101/197] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:22 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:23.249159 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:23.250056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:23.257427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:23.258104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:23.258689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:23.259555 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:23.260183 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:23.260758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:23.286437 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-cb8b4d82-4b96-4c8f-88d4-d9cd3090780e req-d8015b73-bed2-4f58-8eb2-26d11df1c9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80aa0a2a-951c-4113-b7df-d2d32b966e13", "name": "network-vif-plugged", "status": "completed", "tag": "4b802a9e-a37f-4aa5-82ec-1e14deba17d6"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:23.298925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-cb8b4d82-4b96-4c8f-88d4-d9cd3090780e req-d8015b73-bed2-4f58-8eb2-26d11df1c9df service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:23.299644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-cb8b4d82-4b96-4c8f-88d4-d9cd3090780e req-d8015b73-bed2-4f58-8eb2-26d11df1c9df service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:23.300481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-cb8b4d82-4b96-4c8f-88d4-d9cd3090780e req-d8015b73-bed2-4f58-8eb2-26d11df1c9df service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:23.327489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-cb8b4d82-4b96-4c8f-88d4-d9cd3090780e req-d8015b73-bed2-4f58-8eb2-26d11df1c9df service nova] Creating event network-vif-plugged:4b802a9e-a37f-4aa5-82ec-1e14deba17d6 for instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 on hv-cinder-86236 Nov 02 20:31:23.333901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-cb8b4d82-4b96-4c8f-88d4-d9cd3090780e req-d8015b73-bed2-4f58-8eb2-26d11df1c9df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052083 Nov 02 20:31:23.335748 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 102/198] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:23.413050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:23.413883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:23.420647 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:23.421221 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:23.421752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:23.422695 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:23.423231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:23.423834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:23.435958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:23.445487 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-392876c3-8737-4013-8099-d0142a1d2982 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.203038 Nov 02 20:31:23.446075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 97/199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:23 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:23.605003 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:23.618934 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cd5ac0c1-3de6-4584-9866-71aa0a0d0fc2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.211358 Nov 02 20:31:23.620675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 103/200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:23 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:23.842969 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:23.844330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:23.851787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:23.852478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:23.853056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:23.853747 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:23.854350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:23.854763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.033915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:24.045442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-deaea490-5858-4b57-bfae-0b87825184d6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.205149 Nov 02 20:31:24.046677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 98/201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:23 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:24.066131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:24.066737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:24.074234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.074603 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.075033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.077822 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.080921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.081362 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.171052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:24.172206 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:24.188484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.189377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.190104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.194081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.194773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.195632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.377804 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:24.388303 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:24.392085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6ee7cfd4-d59b-4c0c-a08e-255eaf462ce4 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.326922 Nov 02 20:31:24.393283 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 104/202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:24 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:24.400400 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:24.402468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:24.404742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2d052944-63dd-4da3-ba18-021bafcd2b3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.241822 Nov 02 20:31:24.412600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 99/203] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:24 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:24.475737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:24.476362 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:24.487558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.488120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.488584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.489400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.489910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.490826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.647653 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:24.648296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:24.658872 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.659922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.660650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.663394 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:24.664457 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:24.665041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:24.705489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:24.715286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:24.717329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-269b573c-b8f1-4b15-87d1-af089834c773 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.246534 Nov 02 20:31:24.721152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 105/204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:24 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:25.073660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:25.074525 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:25.099232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.100282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.100987 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.103575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.105703 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.106301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.202415 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:25.212790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-071d298d-fd0c-47a4-8e09-a76d57e61d59 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.569937 Nov 02 20:31:25.218080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 100/205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:24 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:25.407385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:25.417740 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:25.418424 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:25.424555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-261521de-8426-4adb-9213-ffcf583cbd3d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.356547 Nov 02 20:31:25.429077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 106/206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:25 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:25.438478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.439019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.444281 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:25.445291 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:25.449318 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.455082 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.457999 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.458718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.470827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.471514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.473014 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.473776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.479703 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.480403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.512373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:25.657435 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:25.666595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4dc9ed82-16d1-4511-a227-2f6045c2dcb2 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.253292 Nov 02 20:31:25.667378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 101/207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:25 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:25.722768 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:25.735199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:25.737215 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:25.738500 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7cc56da9-b996-4690-838c-ea5ad2860214 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.308424 Nov 02 20:31:25.743728 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 107/208] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:25 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:25.752137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:25.752883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:25.764754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.765618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.766084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.766823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:25.767452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:25.768168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:25.946585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:25.956008 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-17ce9073-129f-4611-b49d-7cebe080e611 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.207610 Nov 02 20:31:25.956827 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 102/209] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:25 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:26.238581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:26.239301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:26.245646 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.246138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.246574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.248116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.248116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.248952 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.385140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:26.393238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ea76224d-8a4e-4ed7-a7d7-17b8f26f0899 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.158948 Nov 02 20:31:26.393811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 108/210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:26 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:26.456529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:26.457160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:26.462948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.463421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.463883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.464555 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.465005 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.465422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.607521 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:26.615428 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9c7dc5fb-1b22-4f6d-8a2b-5b10e8b32ad6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.163288 Nov 02 20:31:26.616056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 103/211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:26 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:26.690939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:26.691553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:26.697393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.697874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.698310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.699002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.699456 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.699913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.768857 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:26.769476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:26.776228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.776713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.777150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.777845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.779058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.779667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.835259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:26.843473 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e6b7535b-dc5a-4d23-9e54-675403a77c1f tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.156356 Nov 02 20:31:26.844908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 109/212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:26 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:26.914205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:26.923031 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:26.924481 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:26.925574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-dea54048-f626-4b68-9c4b-44076e3abc5f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.163813 Nov 02 20:31:26.926116 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 104/213] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:26 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:26.980872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:26.981602 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:26.990835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.990835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.990835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:26.990835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:26.991171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:26.991171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.121368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:27.128864 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-048320c0-d025-4f0a-b3f1-5da256baff1c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.152547 Nov 02 20:31:27.129432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 110/214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:26 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:27.416371 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:27.416967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:27.423062 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.423537 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.423994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.424688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.425138 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.425581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.552951 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:27.561540 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5a6773bf-fb8a-4744-a0ed-c742e304ca2e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.148991 Nov 02 20:31:27.562117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 105/215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:27 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:27.638766 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:27.639377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:27.645300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.645784 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.646211 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.646890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.647341 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.647800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.784754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:27.792852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fb5076b2-e7a5-4d8c-a747-58df38f42914 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.158047 Nov 02 20:31:27.793757 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 111/216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:27 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:27.867980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:27.868616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:27.875181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.875692 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.876129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.876817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.877274 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.877699 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.950539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:27.951141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:27.957211 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.957692 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.958175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:27.959002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:27.959482 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:27.959987 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.050793 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:28.058932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8a7b8659-3f84-48b7-af23-5a8c466dc4da tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.194728 Nov 02 20:31:28.060853 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 106/217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:27 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:28.095697 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:28.104004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:28.105442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:28.106583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1c429473-935b-4dea-9b40-7fd58bb7f67b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.160141 Nov 02 20:31:28.107138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 112/218] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:27 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:28.152456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:28.153116 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:28.159249 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:28.159767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:28.160195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.160876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:28.161333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:28.161755 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.331393 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:28.339563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d999820f-3c3f-435c-ab63-036a9ec9a34e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.191104 Nov 02 20:31:28.342675 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 107/219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:28 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:28.443078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-73c5313b-c9aa-4226-b09c-5f987bc6694c req-590f812e-9593-47a7-89ae-44f997040f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6257b48a-e22b-448d-a9be-458c3c9517c9", "name": "network-vif-plugged", "status": "completed", "tag": "0abd5e39-f20b-413e-b780-db9205640fd2"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:28.454798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-73c5313b-c9aa-4226-b09c-5f987bc6694c req-590f812e-9593-47a7-89ae-44f997040f33 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:28.455839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-73c5313b-c9aa-4226-b09c-5f987bc6694c req-590f812e-9593-47a7-89ae-44f997040f33 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:28.456966 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-73c5313b-c9aa-4226-b09c-5f987bc6694c req-590f812e-9593-47a7-89ae-44f997040f33 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.469458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-73c5313b-c9aa-4226-b09c-5f987bc6694c req-590f812e-9593-47a7-89ae-44f997040f33 service nova] Creating event network-vif-plugged:0abd5e39-f20b-413e-b780-db9205640fd2 for instance 6257b48a-e22b-448d-a9be-458c3c9517c9 on hv-cinder-86236 Nov 02 20:31:28.474630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-73c5313b-c9aa-4226-b09c-5f987bc6694c req-590f812e-9593-47a7-89ae-44f997040f33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Nov 02 20:31:28.475221 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 113/220] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:31:28.584788 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:28.585495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:28.591975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:28.592706 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:28.593316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.594156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:28.594786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:28.595372 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.732405 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:28.739197 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-22e558c7-3868-4b2f-8f68-6920ddf35100 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.158327 Nov 02 20:31:28.739794 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 108/221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:28 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:28.816275 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:28.816905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:28.822997 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:28.823473 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:28.823941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.824630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:28.825088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:28.826087 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:28.954027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:28.961683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-585b3dcd-a6d1-49b9-9990-54d0c7f0f4d5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.149707 Nov 02 20:31:28.962254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 114/222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:28 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:29.084148 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:29.084710 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:29.090620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.091292 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.091630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.092316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.092769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.093218 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.133817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:29.134424 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:29.141016 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.141499 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.141925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.142794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.143247 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.143693 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.283657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:29.292362 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:29.293936 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:29.295375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a21b6149-7f1a-4d11-847c-3e701a4c0669 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.165418 Nov 02 20:31:29.296467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 115/223] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:29 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:29.311198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:29.320699 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-26eb7c2f-5cb8-4a0f-98e3-ddac067a4adf tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1314 microversion: 2.1 time: 0.240405 Nov 02 20:31:29.321379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 109/224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:29 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:29.363604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:29.364147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:29.369979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.370458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.370982 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.371747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.372870 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.373293 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.523821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:29.533924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8332ec8f-41ad-419a-b0bb-9482cf749d2e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1362 microversion: 2.1 time: 0.174160 Nov 02 20:31:29.534694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 116/225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:29 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:29.762164 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:29.762771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:29.768783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.769253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.769678 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.770352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.770799 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.771214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.904484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:29.912121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c65755e1-9c2c-43d1-9a08-0eb445f54cab tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.153770 Nov 02 20:31:29.912685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 110/226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:29 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:29.984968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:29.985569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:29.991505 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.992005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.992430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:29.993105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:29.993550 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:29.993963 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.121887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:30.130459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a2f02e19-3c2a-4bb0-8a96-35694d5b0c25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.149866 Nov 02 20:31:30.131037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 117/227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:29 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:30.322358 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:30.322874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:30.329260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.329740 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.330167 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.330844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.331467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.331912 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.346113 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:30.346792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:30.356295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.357439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.364111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.365303 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.366075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.366780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.501708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:30.509094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:30.512057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:30.513807 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:30.515056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7b6ea4b5-97b7-4c4f-a26d-9be31111e6fa tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.196687 Nov 02 20:31:30.515713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 111/228] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:30 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:30.519780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-91153019-cacc-42cc-a336-8871728f43f1 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1501 microversion: 2.1 time: 0.176872 Nov 02 20:31:30.519780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 118/229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:30 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:30.520506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-6a794ed1-47f3-4dec-be57-35f5b22b5d4d req-7cbca630-138b-462c-901c-cbc4e9d15bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9283ec9e-c3c6-4e56-a927-21452503230f", "name": "network-vif-plugged", "status": "completed", "tag": "372a875a-1d32-4fab-896d-2a33843a0aae"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:30.530467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-6a794ed1-47f3-4dec-be57-35f5b22b5d4d req-7cbca630-138b-462c-901c-cbc4e9d15bf5 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.531063 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-6a794ed1-47f3-4dec-be57-35f5b22b5d4d req-7cbca630-138b-462c-901c-cbc4e9d15bf5 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.531583 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-6a794ed1-47f3-4dec-be57-35f5b22b5d4d req-7cbca630-138b-462c-901c-cbc4e9d15bf5 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.543418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-6a794ed1-47f3-4dec-be57-35f5b22b5d4d req-7cbca630-138b-462c-901c-cbc4e9d15bf5 service nova] Creating event network-vif-plugged:372a875a-1d32-4fab-896d-2a33843a0aae for instance 9283ec9e-c3c6-4e56-a927-21452503230f on hv-cinder-86236 Nov 02 20:31:30.549286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-6a794ed1-47f3-4dec-be57-35f5b22b5d4d req-7cbca630-138b-462c-901c-cbc4e9d15bf5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032342 Nov 02 20:31:30.549878 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 112/230] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:30.557149 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:30.558238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:30.564561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.565111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.565644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.566436 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.566952 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.567501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.699583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:30.713163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7e9cd34a-9acd-4f71-9b7a-2ba4fdf8af4b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1549 microversion: 2.1 time: 0.159662 Nov 02 20:31:30.713746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 119/231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:30 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:30.741208 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:30.741829 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:30.748112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.748597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.749094 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.749791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.750247 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.750673 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.879554 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d48ebbc2-6040-4b64-9213-ff02bef4bac1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144077 Nov 02 20:31:30.880489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 113/232] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:31:30 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:30.936679 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:30.937299 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:30.943236 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.943752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.944195 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:30.945736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:30.945736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:30.945941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:31.153134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:31.154896 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:31.161046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:31.161525 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:31.162161 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:31.163189 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:31.163673 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:31.164122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:31.304550 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:31.313168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4c6f9c14-3d01-4ede-bcc9-67d7b75fefb2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.163901 Nov 02 20:31:31.314143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 114/233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:31 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:31.448147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:31.458713 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fda487cc-3cd1-4019-8ec2-0dfe6f957470 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.527213 Nov 02 20:31:31.475169 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 120/234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:30 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:31.541178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:31.541952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:31.549761 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:31.550343 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:31.550884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:31.551667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:31.552188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:31.552741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:31.727310 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:31.736512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:31.737655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:31.738769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1f5d1c13-54be-4ca3-85e7-f9ae924168dd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.201813 Nov 02 20:31:31.739348 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 115/235] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:31 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:31.941938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83954259-a01e-4aba-b6cb-0091f1f4a6f4"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:31.944610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:31.946720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:31.953434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:31.953942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:31.954455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:31.955225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:31.955812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:31.956297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.337140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:32.342583 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:32.358814 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.361074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.362777 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.364170 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.365808 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.366236 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.533156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:32.541292 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-794298c3-cede-43d9-9722-e8419f448c4a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.208028 Nov 02 20:31:32.542329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 116/236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:32 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:32.547122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-fb6c70f5-2f4a-4338-95d9-bf85fc2bfcc2 req-521a644e-8bc2-420d-a187-87dcc075aca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "738d7da5-411f-449b-82cd-ad465b7d559b", "tag": "1c24d96e-aa0a-461b-a216-ded8e5906519"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:32.558135 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fb6c70f5-2f4a-4338-95d9-bf85fc2bfcc2 req-521a644e-8bc2-420d-a187-87dcc075aca2 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.558135 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fb6c70f5-2f4a-4338-95d9-bf85fc2bfcc2 req-521a644e-8bc2-420d-a187-87dcc075aca2 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.558516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fb6c70f5-2f4a-4338-95d9-bf85fc2bfcc2 req-521a644e-8bc2-420d-a187-87dcc075aca2 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.572692 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-fb6c70f5-2f4a-4338-95d9-bf85fc2bfcc2 req-521a644e-8bc2-420d-a187-87dcc075aca2 service nova] Creating event network-changed:1c24d96e-aa0a-461b-a216-ded8e5906519 for instance 738d7da5-411f-449b-82cd-ad465b7d559b on hv-cinder-86236 Nov 02 20:31:32.578413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-fb6c70f5-2f4a-4338-95d9-bf85fc2bfcc2 req-521a644e-8bc2-420d-a187-87dcc075aca2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034896 Nov 02 20:31:32.579087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 117/237] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:32.584668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:32.585413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:32.592461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.592978 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.593581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.594192 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.594655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.595088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.730515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:32.737149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:32.742646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-eb16e022-de71-402c-8d52-055e92db6ab2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.162170 Nov 02 20:31:32.743262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 118/238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:32 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:32.747789 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-783b61f1-0ecc-487f-b0d9-4a91e12e8dba req-240b21b0-bd48-4990-ad9b-4d0075143b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8374bf3-0545-49a4-9acb-3616953c493f", "name": "network-vif-plugged", "status": "completed", "tag": "8b5041b6-2926-4755-abf3-f108f1b4031d"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:32.756849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-783b61f1-0ecc-487f-b0d9-4a91e12e8dba req-240b21b0-bd48-4990-ad9b-4d0075143b38 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.757320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-783b61f1-0ecc-487f-b0d9-4a91e12e8dba req-240b21b0-bd48-4990-ad9b-4d0075143b38 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.759470 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-783b61f1-0ecc-487f-b0d9-4a91e12e8dba req-240b21b0-bd48-4990-ad9b-4d0075143b38 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.770548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-783b61f1-0ecc-487f-b0d9-4a91e12e8dba req-240b21b0-bd48-4990-ad9b-4d0075143b38 service nova] Creating event network-vif-plugged:8b5041b6-2926-4755-abf3-f108f1b4031d for instance a8374bf3-0545-49a4-9acb-3616953c493f on hv-cinder-86236 Nov 02 20:31:32.775221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-783b61f1-0ecc-487f-b0d9-4a91e12e8dba req-240b21b0-bd48-4990-ad9b-4d0075143b38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030847 Nov 02 20:31:32.775845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 119/239] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:32.781997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:32.782690 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:32.788545 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.789461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.789461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.790112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:32.790565 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:32.790984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:32.932184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:32.941957 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:32.943652 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:32.944860 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a2315f3e-2658-4a8b-959e-1368aff5cd1a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1407 microversion: 2.20 time: 0.167856 Nov 02 20:31:32.945460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 120/240] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:32 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:31:33.113726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2a824aa5-6fb2-4e1d-a1c4-a529042a0825 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "POST /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.175575 Nov 02 20:31:33.114346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 121/241] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:31:31 2022] POST /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0/os-volume_attachments => generated 194 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:33.568910 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:33.569526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:33.584284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:33.584755 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:33.590586 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:33.591866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:33.592474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:33.592791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:33.772936 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:33.774301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:33.783114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:33.783952 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:33.793402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:33.795078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:33.795848 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:33.796430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:33.886385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:33.897014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0ad84b83-0c77-4c06-bd39-a304361953da tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.334614 Nov 02 20:31:33.899656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 121/242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:33 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:33.967908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:33.972372 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:33.972981 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:33.976331 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0fe95743-0e26-4c50-aa0a-25ba7fe80e7d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.213718 Nov 02 20:31:33.977109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 122/243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:33 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:33.979605 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:33.980110 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:33.980678 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:33.981430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:33.981885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:33.982304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:34.112121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:34.120061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:34.121484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:34.123298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3c21e3d9-50cf-425a-8900-329eaf022724 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1599 microversion: 2.20 time: 0.157257 Nov 02 20:31:34.123899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 122/244] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:31:33 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:31:34.149521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:34.150011 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:34.156530 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:34.157012 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:34.157449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:34.158131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:34.158587 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:34.159004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:34.175043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:34.240607 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-26c80d9e-c020-47c4-b019-e2ce2c09b5f0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094862 Nov 02 20:31:34.241194 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 123/245] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Nov 2 20:31:34 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:31:34.920086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:34.920766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:34.926701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:34.928171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:34.929927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:34.931173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:34.931704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:34.932286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:35.003199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:35.004687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:35.014875 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:35.015730 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:35.016402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:35.017991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:35.019061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:35.020450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:35.082658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:35.090393 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f14219a3-a66a-4583-add2-a226ffacffcd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1322 microversion: 2.1 time: 0.174928 Nov 02 20:31:35.096275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 123/246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:34 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:35.274725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:35.283323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1f8e3f9a-8145-4946-8abb-f2f643dac26e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.287252 Nov 02 20:31:35.284137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 124/247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:34 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:35.499554 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-f253823f-2e91-4060-8bd5-e1a343ba58a7 req-4892f74b-d83d-43a2-b89e-d16cd3377bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6257b48a-e22b-448d-a9be-458c3c9517c9", "tag": "0abd5e39-f20b-413e-b780-db9205640fd2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:35.509638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f253823f-2e91-4060-8bd5-e1a343ba58a7 req-4892f74b-d83d-43a2-b89e-d16cd3377bdd service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:35.510417 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f253823f-2e91-4060-8bd5-e1a343ba58a7 req-4892f74b-d83d-43a2-b89e-d16cd3377bdd service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:35.510870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f253823f-2e91-4060-8bd5-e1a343ba58a7 req-4892f74b-d83d-43a2-b89e-d16cd3377bdd service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:35.523031 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-f253823f-2e91-4060-8bd5-e1a343ba58a7 req-4892f74b-d83d-43a2-b89e-d16cd3377bdd service nova] Creating event network-changed:0abd5e39-f20b-413e-b780-db9205640fd2 for instance 6257b48a-e22b-448d-a9be-458c3c9517c9 on hv-cinder-86236 Nov 02 20:31:35.528070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-f253823f-2e91-4060-8bd5-e1a343ba58a7 req-4892f74b-d83d-43a2-b89e-d16cd3377bdd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 Nov 02 20:31:35.529514 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 124/248] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:36.118917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:36.119634 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:36.130694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.131685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.132610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.133116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.133820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.134400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.287829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:36.295596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-92ce916c-2073-4a64-976c-dd60c92667c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1517 microversion: 2.1 time: 0.181113 Nov 02 20:31:36.296219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 125/249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:36 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:36.315077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:36.315716 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:36.323821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:36.326249 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.326826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.327268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.328151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.328514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:36.328644 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.329018 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.337002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.338092 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.338536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.340696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.342628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.343782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.387780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lazy-loading 'flavor' on Instance uuid 9283ec9e-c3c6-4e56-a927-21452503230f {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:31:36.557269 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:36.566796 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-33d61640-e120-4af5-a130-634535332848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.257410 Nov 02 20:31:36.568000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 125/250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:36 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:36.719142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6e224a47-688e-4d34-a53b-a25b1e39eb1d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f/action" status: 200 len: 32 microversion: 2.1 time: 0.402976 Nov 02 20:31:36.719808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 126/251] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:31:36 2022] POST /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:31:36.729630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:36.730236 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:36.736248 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.736720 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.737145 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.737819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:36.738264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:36.738681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:36.867370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:36.874922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d1280381-16e4-43b4-bc56-ee03e2338b5d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.149146 Nov 02 20:31:36.875490 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 126/252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:36 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:37.593792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:37.594555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:37.602012 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:37.602588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:37.603069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:37.603795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:37.604251 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:37.605163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:37.748650 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:37.756295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-27ef0177-e0d5-4899-81eb-13f24fd93b9a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1366 microversion: 2.1 time: 0.167960 Nov 02 20:31:37.764533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 127/253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:37 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:37.897844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:37.900265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:37.908834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:37.910048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:37.910630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:37.912504 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:37.913251 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:37.913862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:38.399963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:38.407474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-dee7b763-183b-43b9-8a61-4dc7b13a8b4e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.513669 Nov 02 20:31:38.408077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 127/254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:37 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:38.778941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:38.779552 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:38.786474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:38.786941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:38.787370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:38.788110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:38.788560 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:38.788981 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:38.926138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:38.933996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5994ae04-21e7-4b72-b77b-b7abfe497365 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1556 microversion: 2.1 time: 0.159556 Nov 02 20:31:38.935965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 128/255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:38 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:38.958112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:38.958650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:38.964369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:38.964844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:38.965272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:38.966078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:38.966561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:38.966972 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:39.089522 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c26cd0e3-ab57-44d3-b409-a57b36f5e78b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135269 Nov 02 20:31:39.090116 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 128/256] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:31:38 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:39.431606 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:39.432259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:39.439686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:39.440394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:39.440993 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:39.441694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:39.442304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:39.442878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:39.678223 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:39.691909 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-08ce0a06-2c91-406c-bceb-e5a07175009b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.264314 Nov 02 20:31:39.692955 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 129/257] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:39 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:40.342699 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-85774d04-27e7-452f-998d-b7c352de0243 req-b2240cbd-5073-45c6-8f26-de22fa4149b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8374bf3-0545-49a4-9acb-3616953c493f", "tag": "8b5041b6-2926-4755-abf3-f108f1b4031d"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:40.354833 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-85774d04-27e7-452f-998d-b7c352de0243 req-b2240cbd-5073-45c6-8f26-de22fa4149b6 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:40.355744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-85774d04-27e7-452f-998d-b7c352de0243 req-b2240cbd-5073-45c6-8f26-de22fa4149b6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:40.356599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-85774d04-27e7-452f-998d-b7c352de0243 req-b2240cbd-5073-45c6-8f26-de22fa4149b6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:40.372875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-85774d04-27e7-452f-998d-b7c352de0243 req-b2240cbd-5073-45c6-8f26-de22fa4149b6 service nova] Creating event network-changed:8b5041b6-2926-4755-abf3-f108f1b4031d for instance a8374bf3-0545-49a4-9acb-3616953c493f on hv-cinder-86236 Nov 02 20:31:40.379916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-85774d04-27e7-452f-998d-b7c352de0243 req-b2240cbd-5073-45c6-8f26-de22fa4149b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041554 Nov 02 20:31:40.381391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 129/258] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:31:40.716362 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:40.717576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:40.726080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:40.726563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:40.727194 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:40.728490 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:40.729140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:40.729726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:40.894772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:40.907834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fb7f3204-9e61-43e6-8903-513f06074497 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.196302 Nov 02 20:31:40.919645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 130/259] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:40 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:41.932784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:41.933735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:41.940886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:41.941443 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:41.941834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:41.942538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:41.943016 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:41.943465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:42.111999 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:42.120091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a1849d1f-a228-4bd6-9168-b6b027f6c58f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.192001 Nov 02 20:31:42.120856 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 130/260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:41 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:43.145129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:43.145715 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:43.152361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:43.153110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:43.154296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:43.155009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:43.155474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:43.156012 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:43.298050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:43.305826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bc635e3a-ddf8-438f-9531-22760ba638e8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.164767 Nov 02 20:31:43.322044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 131/261] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:43 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:44.329637 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:44.330276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:44.336657 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:44.336917 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:44.337353 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:44.338053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:44.338506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:44.338928 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:44.469443 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:44.477037 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3f96d10a-dcc2-46d5-a551-e7957dd30bbe tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.151257 Nov 02 20:31:44.477600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 131/262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:44 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:44.745453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-742150622", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "networks": [{"uuid": "fe9b1c21-4541-4329-93cc-06d411cbc585"}]}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:44.799412 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] validate_networks() for [('fe9b1c21-4541-4329-93cc-06d411cbc585', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:31:45.148141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:31:45.148559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:31:45.149025 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:31:45.149433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:31:45.149838 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:31:45.159457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:45.159893 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:45.160335 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:45.161048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:45.161494 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:45.161910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:45.179720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Getting quotas for project 47c08bba480f466dbd6cab623f352d6d. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:31:45.183730 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Getting quotas for user f9fa184d2c7a49819d2b47e47875da00 and project 47c08bba480f466dbd6cab623f352d6d. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:31:45.198409 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:31:45.201321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:31:45.246422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f27916e7-4bde-407b-afba-653d22a7696f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505028 Nov 02 20:31:45.247594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 132/263] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:31:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:31:45.258618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-56d37e7a-af75-446c-a90c-9b23428619c5 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:45.259253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-56d37e7a-af75-446c-a90c-9b23428619c5 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:45.311215 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-56d37e7a-af75-446c-a90c-9b23428619c5 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:45.318142 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-56d37e7a-af75-446c-a90c-9b23428619c5 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1213 microversion: 2.1 time: 0.063298 Nov 02 20:31:45.318832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 132/264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:45 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:45.501391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:45.501940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:45.508741 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:45.509227 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:45.509689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:45.510404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:45.510861 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:45.511287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:45.643524 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:45.651715 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-730e6d47-294c-4625-b660-ce38589c2d9d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.154667 Nov 02 20:31:45.663786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 133/265] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:45 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:46.008021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:46.008892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:46.014978 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.015469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.015939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.016633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.017088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.017520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.045585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:31:46.119445 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:46.139853 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e3dd4e1f-5afa-4830-ad4b-0f9b29916f9b tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 204 len: 0 microversion: 2.1 time: 0.135345 Nov 02 20:31:46.143975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 133/266] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:31:46 2022] DELETE /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:31:46.149915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:46.150631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:46.158162 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.158641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.159068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.159779 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.160228 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.160644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.292354 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:46.301101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d337b6e7-7f4e-4b5b-a6ea-df5a859f8a04 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1553 microversion: 2.1 time: 0.156120 Nov 02 20:31:46.301664 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 134/267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:46 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:46.342320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:46.343010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:46.348976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.349451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.349884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.350570 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.351071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.351489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.417139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:46.425509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-baae010d-72d4-424c-b598-0aee12a277b3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1265 microversion: 2.1 time: 0.087517 Nov 02 20:31:46.426074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 134/268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:46 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:46.675916 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:46.676450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:46.682604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.683079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.683531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.685150 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:46.685608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:46.686026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:46.817054 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:46.826110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7a485746-e6e6-4269-b1fd-bde910c96af4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.153551 Nov 02 20:31:46.826809 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 135/269] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:46 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:47.324043 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:47.324540 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:47.330933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:47.331425 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:47.331884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:47.332581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:47.333026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:47.333477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:47.449462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:47.450671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:47.456894 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:47.457382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:47.457806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:47.458497 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:47.458932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:47.459352 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:47.459497 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:47.468729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0892881a-7c57-4130-85b7-8363b1a0d44a tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1553 microversion: 2.1 time: 0.148918 Nov 02 20:31:47.469304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 135/270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:47 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:47.524311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:47.532377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-07ceee7c-06d7-4074-a7ff-4dc29b3ba847 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1265 microversion: 2.1 time: 0.086716 Nov 02 20:31:47.532937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 136/271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:47 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:47.849611 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:47.850411 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:47.856711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:47.857393 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:47.857750 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:47.858427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:47.858900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:47.859336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:47.985379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:47.992961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1eff02fc-1c52-48b0-ace0-0008d545d4e4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.147149 Nov 02 20:31:47.993548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 136/272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:47 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:48.492114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:48.492726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:48.499775 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:48.500285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:48.500717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:48.501399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:48.501860 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:48.502278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:48.554272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:48.554993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:48.561710 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:48.562754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:48.562754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:48.563323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:48.563813 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:48.564237 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:48.568996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:48.637030 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:48.642971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:48.644684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-36a83604-0205-492b-b4e0-c219ba45c82e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1265 microversion: 2.1 time: 0.094327 Nov 02 20:31:48.645269 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 137/273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:48 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:48.651677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0117399e-26a5-4120-8e19-fc9ee77365cb tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1553 microversion: 2.1 time: 0.163359 Nov 02 20:31:48.652231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 137/274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:48 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:49.016686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:49.017292 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:49.023152 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:49.023644 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:49.024087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:49.024763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:49.025212 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:49.025630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:49.245708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:49.256156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-529534be-6302-4429-91aa-b976f268260f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.243499 Nov 02 20:31:49.257090 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 138/275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:49 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:49.669792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:49.674887 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:49.675508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:49.677640 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:49.685999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:49.687096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:49.687363 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:49.687884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:49.688317 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:49.688608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:49.689027 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:49.689478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:49.689889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:49.690534 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:49.691384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:49.692501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:49.771333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:49.783253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-511c5e62-7a27-4204-9038-db0f407ec75c tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1271 microversion: 2.1 time: 0.118597 Nov 02 20:31:49.783899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 138/276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:49 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:50.086817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:50.096346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-350c01cc-08db-400d-8409-65ee367d2c39 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1553 microversion: 2.1 time: 0.425232 Nov 02 20:31:50.096921 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 139/277] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:49 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1553 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:50.282734 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:50.283339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:50.289567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:50.290048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:50.290478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:50.291175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:50.291640 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:50.292062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:50.296293 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:50.447315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:50.456118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-597d2288-afca-4b81-82b0-b919ae98e688 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.177891 Nov 02 20:31:50.457044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 139/278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:50 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:50.514863 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-f51b66fe-695e-45de-8302-5d5fddcc4d99 req-e2b14692-eca3-4a82-a1ea-0357c56450d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b480405-4306-48e6-9bca-1f90443f0bd0", "name": "network-vif-deleted", "tag": "8ea050fb-d23a-40db-97f4-4c903e422a1e"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:50.531357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f51b66fe-695e-45de-8302-5d5fddcc4d99 req-e2b14692-eca3-4a82-a1ea-0357c56450d1 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:50.531926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f51b66fe-695e-45de-8302-5d5fddcc4d99 req-e2b14692-eca3-4a82-a1ea-0357c56450d1 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:50.532523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f51b66fe-695e-45de-8302-5d5fddcc4d99 req-e2b14692-eca3-4a82-a1ea-0357c56450d1 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:50.550410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-f51b66fe-695e-45de-8302-5d5fddcc4d99 req-e2b14692-eca3-4a82-a1ea-0357c56450d1 service nova] Creating event network-vif-deleted:8ea050fb-d23a-40db-97f4-4c903e422a1e for instance 4b480405-4306-48e6-9bca-1f90443f0bd0 on hv-cinder-86236 Nov 02 20:31:50.557013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-f51b66fe-695e-45de-8302-5d5fddcc4d99 req-e2b14692-eca3-4a82-a1ea-0357c56450d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047023 Nov 02 20:31:50.557892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 140/279] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:50.808558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:50.810059 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:50.816602 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:50.817093 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:50.817527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:50.818228 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:50.818686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:50.819112 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:50.952629 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:50.961071 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-98c9f3c4-ed1b-497e-8fa8-d73a04a975b8 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.156460 Nov 02 20:31:50.961869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 140/280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:50 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:51.122975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:51.123694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:51.129711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:51.130187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:51.130621 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:51.131334 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:51.131821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:51.132251 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:51.168126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:51.172236 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:51.172704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:51.173816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lazy-loading 'fault' on Instance uuid 4b480405-4306-48e6-9bca-1f90443f0bd0 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:31:51.231946 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf2fcd264e470094e30cfe9b154486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5257c2c600454a4aa4b37dfc35c6a5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:51.240011 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-459eac7a-88df-4d4f-8867-8d78c133ecfe tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 200 len: 1350 microversion: 2.1 time: 0.122499 Nov 02 20:31:51.240889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 141/281] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:51 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 1350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:51.479962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:51.480501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:51.486914 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:51.487403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:51.487862 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:51.488587 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:51.489038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:51.489457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:51.622538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:51.630148 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2444512f-ad65-43c0-977a-0657f299bd1e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.154419 Nov 02 20:31:51.630713 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 141/282] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:51 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:51.986538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:51.987295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:51.993815 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:51.994389 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:51.994932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:51.995763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:51.996312 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:51.997384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.263644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:52.264302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:52.270518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:52.271007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:52.271436 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.272228 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:52.272688 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:52.273114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.287199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] HTTP exception thrown: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Request method failure captured: Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 HTTP/1.1 Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNiFZeQa4MgoCFJJXHClgGp6ydwjGbRHShH5Wzz2FJgFT9JdiJxQbij3J6ztgZjTK6U-fsQ5Yo5XNbRcaj-yd1ukP3QOLt4lI2yNo0QiidPyP9u2haQXbKqlCf-OCsQbixfuh6iV0yA096dQvQxxuKFes4XEDeF7QniT5YJVkQR-7s Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:31:52.292046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}] Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: bdcf2fcd264e470094e30cfe9b154486 Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.294941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '4b480405-4306-48e6-9bca-1f90443f0bd0'} Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:52.297193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.299918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.302190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Returning 404 to user: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:52.302190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-21205301-b140-4ca3-900b-e7b4d67b80ac tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 404 len: 111 microversion: 2.1 time: 0.033852 Nov 02 20:31:52.302190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 142/283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:52 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 20:31:52.314423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:52.323531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-77de82b1-8b5b-42d5-80b7-7d7d939c95c3 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.341015 Nov 02 20:31:52.324203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 142/284] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:51 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:52.415043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:52.417536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:52.423500 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:52.424013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:52.424442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.425120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:52.425569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:52.425988 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.438852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] HTTP exception thrown: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Request method failure captured: Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0/os-volume_attachments HTTP/1.1 Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNiFZeQa4MgoCFJJXHClgGp6ydwjGbRHShH5Wzz2FJgFT9JdiJxQbij3J6ztgZjTK6U-fsQ5Yo5XNbRcaj-yd1ukP3QOLt4lI2yNo0QiidPyP9u2haQXbKqlCf-OCsQbixfuh6iV0yA096dQvQxxuKFes4XEDeF7QniT5YJVkQR-7s Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:31:52.447386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}] Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: bdcf2fcd264e470094e30cfe9b154486 Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.448825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'server_id': '4b480405-4306-48e6-9bca-1f90443f0bd0'} Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:52.450117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:52.451178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:52.452319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Returning 404 to user: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:52.452319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-95e47155-e50a-482d-b8d7-6ced3f6bfa10 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037717 Nov 02 20:31:52.452319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 143/285] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:31:52 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:31:52.574311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-a770e797-d3da-44d1-b877-23491e2f435b req-d68f5139-cbc8-4862-ad74-0753c96a9408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042b4744-dabc-4cfd-94c3-88306f92216b", "tag": "b2baf117-366d-4d9f-9194-5fc4e8ba940c"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:52.583979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a770e797-d3da-44d1-b877-23491e2f435b req-d68f5139-cbc8-4862-ad74-0753c96a9408 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:52.584458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a770e797-d3da-44d1-b877-23491e2f435b req-d68f5139-cbc8-4862-ad74-0753c96a9408 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:52.584884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a770e797-d3da-44d1-b877-23491e2f435b req-d68f5139-cbc8-4862-ad74-0753c96a9408 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.595512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-a770e797-d3da-44d1-b877-23491e2f435b req-d68f5139-cbc8-4862-ad74-0753c96a9408 service nova] Creating event network-changed:b2baf117-366d-4d9f-9194-5fc4e8ba940c for instance 042b4744-dabc-4cfd-94c3-88306f92216b on hv-cinder-86236 Nov 02 20:31:52.600586 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-a770e797-d3da-44d1-b877-23491e2f435b req-d68f5139-cbc8-4862-ad74-0753c96a9408 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030342 Nov 02 20:31:52.601178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 143/286] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:52.652793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:52.653437 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:52.659500 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:52.660031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:52.660541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.661233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:52.661690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:52.662121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:52.794596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:52.802119 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d2107293-bd4f-407c-9b2e-f4a80f701488 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.153376 Nov 02 20:31:52.802680 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 144/287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:52 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:53.347423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:53.348345 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:53.354460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.355011 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.355440 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.356194 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.356639 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.357049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.482651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:53.490148 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-31f2d172-aa4f-4d39-a321-391f692d4cd9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.146993 Nov 02 20:31:53.490709 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 144/288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:53 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:31:53.655926 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:53.656469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:53.662765 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.663241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.663696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.664376 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.664830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.665271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.678337 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] HTTP exception thrown: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Request method failure captured: Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 HTTP/1.1 Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNiFZeQa4MgoCFJJXHClgGp6ydwjGbRHShH5Wzz2FJgFT9JdiJxQbij3J6ztgZjTK6U-fsQ5Yo5XNbRcaj-yd1ukP3QOLt4lI2yNo0QiidPyP9u2haQXbKqlCf-OCsQbixfuh6iV0yA096dQvQxxuKFes4XEDeF7QniT5YJVkQR-7s Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:31:53.679882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}] Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: bdcf2fcd264e470094e30cfe9b154486 Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.681285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '4b480405-4306-48e6-9bca-1f90443f0bd0'} Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:53.682200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.683457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.685611 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Returning 404 to user: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:53.685611 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-735b50bb-ac07-48ba-895c-3f72e10d5199 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 404 len: 111 microversion: 2.1 time: 0.029172 Nov 02 20:31:53.685611 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 145/289] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:31:53 2022] DELETE /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:31:53.690322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:53.690919 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] [instance: 4b480405-4306-48e6-9bca-1f90443f0bd0] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:53.696901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.697373 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.697798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.698475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.698924 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.699339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.712897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] HTTP exception thrown: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Request method failure captured: Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 HTTP/1.1 Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNiFZeQa4MgoCFJJXHClgGp6ydwjGbRHShH5Wzz2FJgFT9JdiJxQbij3J6ztgZjTK6U-fsQ5Yo5XNbRcaj-yd1ukP3QOLt4lI2yNo0QiidPyP9u2haQXbKqlCf-OCsQbixfuh6iV0yA096dQvQxxuKFes4XEDeF7QniT5YJVkQR-7s Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:31:53.717563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5257c2c600454a4aa4b37dfc35c6a5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5257c2c600454a4aa4b37dfc35c6a5ee"}]}] Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 5257c2c600454a4aa4b37dfc35c6a5ee Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-DeleteServersTestJSON-716815245 Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: bdcf2fcd264e470094e30cfe9b154486 Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-DeleteServersTestJSON-716815245-project Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.718927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '4b480405-4306-48e6-9bca-1f90443f0bd0'} Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:53.719737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. Nov 02 20:31:53.721060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:53.722201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] Returning 404 to user: Instance 4b480405-4306-48e6-9bca-1f90443f0bd0 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:53.722201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2ba2da93-1f80-43a8-b7fd-7f4db24eef62 tempest-DeleteServersTestJSON-716815245 tempest-DeleteServersTestJSON-716815245-project] 10.222.0.26 "GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0" status: 404 len: 111 microversion: 2.1 time: 0.032487 Nov 02 20:31:53.722201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 145/290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:53 2022] GET /compute/v2.1/servers/4b480405-4306-48e6-9bca-1f90443f0bd0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 20:31:53.826145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:53.827017 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:53.832858 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.833379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.833810 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.834499 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:53.834955 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:53.835379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:53.963859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:53.971701 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c49f583e-040d-4387-8cec-2e0d3caac3e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.150269 Nov 02 20:31:53.972399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:53 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:54.514826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:54.515355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:54.521355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:54.521828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:54.522331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:54.523013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:54.523456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:54.523894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:54.725047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:54.743961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-61ca59f8-87d8-4e5e-bce9-1281ae700437 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.233057 Nov 02 20:31:54.744553 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 146/292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:54 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:54.995321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:54.996217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:55.002803 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:55.003413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:55.003939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:55.004696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:55.005219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:55.005708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:55.149816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:55.167197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b5737e87-f5b4-4aed-821c-ee752dcc8b7b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.175446 Nov 02 20:31:55.168264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 147/293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:54 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:55.767600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:55.768714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:55.770371 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:55.777181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:55.777719 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:55.778899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:55.779709 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:55.780187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:55.780615 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:55.940683 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:55.950478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-79aa6722-3461-4982-8223-b1f4ce6f2031 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.187313 Nov 02 20:31:55.966897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 147/294] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:55 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:56.190959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:56.191563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:56.193754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:56.194554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=6 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:56.201546 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:56.202221 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:56.205930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:56.206921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:56.207461 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:56.208102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:56.436252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:56.450137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1b7bdef8-08a0-4358-8795-f3f0a52dddd9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.261733 Nov 02 20:31:56.454359 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 148/295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:56 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:56.973771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:56.974372 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:56.980321 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:56.980809 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:56.981362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:56.982056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:56.982502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:56.982913 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:57.124331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:57.133766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cd6da369-5c1d-44d6-a91f-a8d72a6acba9 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.163810 Nov 02 20:31:57.134499 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 148/296] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:56 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:57.477472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:57.478654 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:57.488040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:57.488694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:57.489271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:57.490081 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:57.490640 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:57.491675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:57.704948 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:57.713513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-966d4f8e-b3a5-4ccd-a518-93b97183eb3c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.242722 Nov 02 20:31:57.714145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 149/297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:57 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:57.900946 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-61057703-b900-432b-b748-8500abe081d3 req-93411bc8-282f-4430-81eb-2e93dac3de57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042b4744-dabc-4cfd-94c3-88306f92216b", "name": "network-vif-plugged", "status": "completed", "tag": "b2baf117-366d-4d9f-9194-5fc4e8ba940c"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:57.912714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-61057703-b900-432b-b748-8500abe081d3 req-93411bc8-282f-4430-81eb-2e93dac3de57 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:57.913280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-61057703-b900-432b-b748-8500abe081d3 req-93411bc8-282f-4430-81eb-2e93dac3de57 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:57.914321 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-61057703-b900-432b-b748-8500abe081d3 req-93411bc8-282f-4430-81eb-2e93dac3de57 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:57.927765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-61057703-b900-432b-b748-8500abe081d3 req-93411bc8-282f-4430-81eb-2e93dac3de57 service nova] Creating event network-vif-plugged:b2baf117-366d-4d9f-9194-5fc4e8ba940c for instance 042b4744-dabc-4cfd-94c3-88306f92216b on hv-cinder-86236 Nov 02 20:31:57.933190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-61057703-b900-432b-b748-8500abe081d3 req-93411bc8-282f-4430-81eb-2e93dac3de57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035803 Nov 02 20:31:57.934935 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 149/298] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:31:58.158121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:58.158737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:58.164624 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:58.165144 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:58.165577 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:58.166271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:58.167902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:58.168407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:58.310764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:58.319815 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2fc668ef-5339-4474-a22e-4d0d40e88a89 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.165539 Nov 02 20:31:58.320386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 150/299] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:58 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:58.744719 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:58.745442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:58.752209 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:58.752892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:58.753781 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:58.754515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:58.754994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:58.755485 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:58.890666 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:58.898594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-34d250d1-022e-4433-bd74-8e02f0c09c44 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.158653 Nov 02 20:31:58.899154 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 150/300] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:58 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:58.912008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1ecee5de-ff67-4e41-a846-94450a62dab1 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Action: 'create', calling method: .version_select at 0x7f2e22580c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1370683540", "metadata": {"Type": "work"}}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1ecee5de-ff67-4e41-a846-94450a62dab1 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Request method failure captured: Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 122 Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtO-c1pEGjOxEzqmg670-0rFo_is8JPYGCsggT5bdxO3Tw77yMDJorUT1YZn31VNbsoriHY49t6Or26_Esvhj7g9_sj4lLDHt1hKnP-ta78E_sHyprGxZaddOyKuHzx9px_c8dG9SwwyCna1LxU8WsSxdOSCAoaQsXXuOppducOw2v0 Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:31:58.929605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}] Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: e87e6282310f4d81838c84af1e4663a7 Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1370683540", "metadata": {"Type": "work"}}} Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: Nov 02 20:31:58.931055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1370683540', 'metadata': {'Type': 'work'}}}} Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise error Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:58.931999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 20:31:58.933528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 20:31:58.936022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 20:31:58.936022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.936022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1ecee5de-ff67-4e41-a846-94450a62dab1 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:58.936022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1ecee5de-ff67-4e41-a846-94450a62dab1 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.138070 Nov 02 20:31:58.936022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 151/301] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 20:31:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 20:31:58.941502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e42d14ed-a8d1-40a4-a2ba-9e359e034d1c tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Action: 'create', calling method: .version_select at 0x7f2e223eb940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-767770487", "metadata": {"Type": "work"}}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e42d14ed-a8d1-40a4-a2ba-9e359e034d1c tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Request method failure captured: Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 119 Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtO-c1pEGjOxEzqmg670-0rFo_is8JPYGCsggT5bdxO3Tw77yMDJorUT1YZn31VNbsoriHY49t6Or26_Esvhj7g9_sj4lLDHt1hKnP-ta78E_sHyprGxZaddOyKuHzx9px_c8dG9SwwyCna1LxU8WsSxdOSCAoaQsXXuOppducOw2v0 Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:31:58.946439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}] Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: e87e6282310f4d81838c84af1e4663a7 Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-767770487", "metadata": {"Type": "work"}}} Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: Nov 02 20:31:58.947901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-767770487', 'metadata': {'Type': 'work'}}}} Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise error Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi '0' Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:58.948897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 20:31:58.950995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 20:31:58.952468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 20:31:58.952468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.952468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e42d14ed-a8d1-40a4-a2ba-9e359e034d1c tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:58.952468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e42d14ed-a8d1-40a4-a2ba-9e359e034d1c tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010250 Nov 02 20:31:58.952468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 151/302] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 20:31:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 20:31:58.957302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8fc28996-baef-4739-bc95-a4a18e2d1606 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Action: 'create', calling method: .version_select at 0x7f2e22304160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1652952335", "metadata": {"Type": "work"}}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8fc28996-baef-4739-bc95-a4a18e2d1606 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Request method failure captured: Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 119 Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtO-c1pEGjOxEzqmg670-0rFo_is8JPYGCsggT5bdxO3Tw77yMDJorUT1YZn31VNbsoriHY49t6Or26_Esvhj7g9_sj4lLDHt1hKnP-ta78E_sHyprGxZaddOyKuHzx9px_c8dG9SwwyCna1LxU8WsSxdOSCAoaQsXXuOppducOw2v0 Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:31:58.961945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}] Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: e87e6282310f4d81838c84af1e4663a7 Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1652952335", "metadata": {"Type": "work"}}} Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: Nov 02 20:31:58.963368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1652952335', 'metadata': {'Type': 'work'}}}} Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise error Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi '' Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:58.964252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 20:31:58.965740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 20:31:58.967077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 20:31:58.967077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:58.967077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8fc28996-baef-4739-bc95-a4a18e2d1606 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:58.967077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8fc28996-baef-4739-bc95-a4a18e2d1606 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009817 Nov 02 20:31:58.967077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 152/303] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 20:31:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 20:31:58.972252 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a9e2ca8a-f500-4484-820e-624f4ddbee7d tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Calling method '.version_select at 0x7f2e2237f550>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:59.000889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-a9e2ca8a-f500-4484-820e-624f4ddbee7d tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] HTTP exception thrown: Volume tempest-invalid-1054028885 could not be found. Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a9e2ca8a-f500-4484-820e-624f4ddbee7d tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Request method failure captured: Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1054028885 HTTP/1.1 Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtO-c1pEGjOxEzqmg670-0rFo_is8JPYGCsggT5bdxO3Tw77yMDJorUT1YZn31VNbsoriHY49t6Or26_Esvhj7g9_sj4lLDHt1hKnP-ta78E_sHyprGxZaddOyKuHzx9px_c8dG9SwwyCna1LxU8WsSxdOSCAoaQsXXuOppducOw2v0 Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:31:59.002848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}] Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: e87e6282310f4d81838c84af1e4663a7 Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Volume tempest-invalid-1054028885 could not be found. Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'tempest-invalid-1054028885'} Nov 02 20:31:59.004262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1054028885 could not be found. (HTTP 404) (Request-ID: req-bafd6eb2-d9fa-41cf-99a0-6aebce47c952) Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.005175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 20:31:59.006608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1054028885 could not be found. Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:31:59.007932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1054028885 could not be found. Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1054028885 could not be found. Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a9e2ca8a-f500-4484-820e-624f4ddbee7d tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Returning 404 to user: Volume tempest-invalid-1054028885 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a9e2ca8a-f500-4484-820e-624f4ddbee7d tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1054028885" status: 404 len: 99 microversion: 2.1 time: 0.035679 Nov 02 20:31:59.009754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 152/304] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Nov 2 20:31:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1054028885 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 20:31:59.013578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e042bf94-2b2e-4156-b327-69ff86846ca7 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003782 Nov 02 20:31:59.014063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 153/305] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Nov 2 20:31:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 20:31:59.022705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c56814ae-1e92-4d68-ad2b-45575eab82fa tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003753 Nov 02 20:31:59.023497 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 153/306] 10.222.0.26 () {58 vars in 1137 bytes} [Wed Nov 2 20:31:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 20:31:59.031942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e89d52e5-1c26-4af6-9cca-a86548264824 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Calling method '.version_select at 0x7f2e22580a60>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:59.060259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-e89d52e5-1c26-4af6-9cca-a86548264824 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] HTTP exception thrown: Volume f19c4a21-d440-480c-9d03-b2a964782010 could not be found. Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e89d52e5-1c26-4af6-9cca-a86548264824 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Request method failure captured: Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/os-volumes/f19c4a21-d440-480c-9d03-b2a964782010 HTTP/1.1 Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtO-c1pEGjOxEzqmg670-0rFo_is8JPYGCsggT5bdxO3Tw77yMDJorUT1YZn31VNbsoriHY49t6Or26_Esvhj7g9_sj4lLDHt1hKnP-ta78E_sHyprGxZaddOyKuHzx9px_c8dG9SwwyCna1LxU8WsSxdOSCAoaQsXXuOppducOw2v0 Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:31:59.062220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}] Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: e87e6282310f4d81838c84af1e4663a7 Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Volume f19c4a21-d440-480c-9d03-b2a964782010 could not be found. Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'f19c4a21-d440-480c-9d03-b2a964782010'} Nov 02 20:31:59.063628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f19c4a21-d440-480c-9d03-b2a964782010 could not be found. (HTTP 404) (Request-ID: req-cdd66e1d-33c0-4586-9efb-54916d2b80a8) Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.064387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 20:31:59.065414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f19c4a21-d440-480c-9d03-b2a964782010 could not be found. Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 20:31:59.066441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f19c4a21-d440-480c-9d03-b2a964782010 could not be found. Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f19c4a21-d440-480c-9d03-b2a964782010 could not be found. Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e89d52e5-1c26-4af6-9cca-a86548264824 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Returning 404 to user: Volume f19c4a21-d440-480c-9d03-b2a964782010 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e89d52e5-1c26-4af6-9cca-a86548264824 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f19c4a21-d440-480c-9d03-b2a964782010" status: 404 len: 109 microversion: 2.1 time: 0.035783 Nov 02 20:31:59.067467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 154/307] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:31:59 2022] DELETE /compute/v2.1/os-volumes/f19c4a21-d440-480c-9d03-b2a964782010 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 20:31:59.073094 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5e4e4781-eccd-40db-ad0f-b01d7b19ff60 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Calling method '.version_select at 0x7f2e223eb550>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:59.101250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-5e4e4781-eccd-40db-ad0f-b01d7b19ff60 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] HTTP exception thrown: Volume 8e96b8e5-2844-4a11-8e2d-3ebeedf59101 could not be found. Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5e4e4781-eccd-40db-ad0f-b01d7b19ff60 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Request method failure captured: Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/os-volumes/8e96b8e5-2844-4a11-8e2d-3ebeedf59101 HTTP/1.1 Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtO-c1pEGjOxEzqmg670-0rFo_is8JPYGCsggT5bdxO3Tw77yMDJorUT1YZn31VNbsoriHY49t6Or26_Esvhj7g9_sj4lLDHt1hKnP-ta78E_sHyprGxZaddOyKuHzx9px_c8dG9SwwyCna1LxU8WsSxdOSCAoaQsXXuOppducOw2v0 Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:31:59.103191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d870ca0536a34280a32e9e7528f3efb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d870ca0536a34280a32e9e7528f3efb2"}]}] Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: d870ca0536a34280a32e9e7528f3efb2 Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-VolumesNegativeTest-1397695252 Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: e87e6282310f4d81838c84af1e4663a7 Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-VolumesNegativeTest-1397695252-project Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Volume 8e96b8e5-2844-4a11-8e2d-3ebeedf59101 could not be found. Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '8e96b8e5-2844-4a11-8e2d-3ebeedf59101'} Nov 02 20:31:59.104486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e96b8e5-2844-4a11-8e2d-3ebeedf59101 could not be found. (HTTP 404) (Request-ID: req-e41f6700-b08f-403b-9029-4a1e8d8e4231) Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.105196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:31:59.106868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e96b8e5-2844-4a11-8e2d-3ebeedf59101 could not be found. Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 20:31:59.107915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e96b8e5-2844-4a11-8e2d-3ebeedf59101 could not be found. Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e96b8e5-2844-4a11-8e2d-3ebeedf59101 could not be found. Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5e4e4781-eccd-40db-ad0f-b01d7b19ff60 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] Returning 404 to user: Volume 8e96b8e5-2844-4a11-8e2d-3ebeedf59101 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5e4e4781-eccd-40db-ad0f-b01d7b19ff60 tempest-VolumesNegativeTest-1397695252 tempest-VolumesNegativeTest-1397695252-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e96b8e5-2844-4a11-8e2d-3ebeedf59101" status: 404 len: 109 microversion: 2.1 time: 0.035345 Nov 02 20:31:59.110049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 154/308] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:31:59 2022] GET /compute/v2.1/os-volumes/8e96b8e5-2844-4a11-8e2d-3ebeedf59101 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:31:59.342579 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:59.343831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:59.349995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:59.350485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:59.351100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:59.351596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:59.352149 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:59.352792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:59.507645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:31:59.515428 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9abbba66-e1af-48af-87b2-670a19fb3cb7 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1313 microversion: 2.1 time: 0.177051 Nov 02 20:31:59.516033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 155/309] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:59 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:31:59.924073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:31:59.924726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:31:59.932988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:59.933474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:59.934779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:31:59.935856 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:31:59.936628 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:31:59.937204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:00.090328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:00.099867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6c1ff1fe-1ea2-4712-87a9-3273ed97554e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.181444 Nov 02 20:32:00.100852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 155/310] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:31:59 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:00.538971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:00.539581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:00.547663 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:00.548142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:00.548568 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:00.549256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:00.549706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:00.550121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:00.688885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:00.696467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cca45748-d6ef-4ac1-a449-e3cd07742b69 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1497 microversion: 2.1 time: 0.161445 Nov 02 20:32:00.697034 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 156/311] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:00 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:01.127803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:01.128437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:01.134238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:01.134707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:01.135127 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:01.135829 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:01.136273 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:01.136684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:01.275456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:01.296133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cbab9e1c-279c-436e-9094-d85acda4c729 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.171493 Nov 02 20:32:01.296820 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 156/312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:01 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:01.301310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:01.301872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:01.307720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:01.308202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:01.308636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:01.309355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:01.310223 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:01.310640 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:01.338847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:32:01.421651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2fd716a0-4c3e-43a5-aa96-ecb7a9d2347b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "DELETE /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 204 len: 0 microversion: 2.1 time: 0.123760 Nov 02 20:32:01.422232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 157/313] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:32:01 2022] DELETE /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:32:01.430237 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:01.430838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:01.437211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:01.437694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:01.438121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:01.438812 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:01.439264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:01.439716 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:01.618456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:01.628222 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-355283d4-4b28-460f-a854-2cbe53c26edb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1503 microversion: 2.1 time: 0.201735 Nov 02 20:32:01.628899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 157/314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:01 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:02.319489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:02.320293 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:02.322469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:02.328301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:02.328855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:02.329371 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:02.330141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:02.330658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:02.331170 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:02.476458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:02.485064 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-532aa9b4-3dfe-48d0-82b1-a6f96b3ec3a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.169838 Nov 02 20:32:02.485628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 158/315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:02 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:02.651545 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:02.652276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:02.658932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:02.659461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:02.659993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:02.660759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:02.661262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:02.661714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:02.803667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:02.812101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c5f6e25b-51c4-4c60-b2d0-f3d168a7423b tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1503 microversion: 2.1 time: 0.164266 Nov 02 20:32:02.812664 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 158/316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:02 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:03.508795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:03.509558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:03.516131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:03.516614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:03.517049 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:03.517738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:03.518189 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:03.518788 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:03.655236 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:03.665163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3965580a-e4af-4d81-9e57-0bd97008239d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.160260 Nov 02 20:32:03.665976 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 159/317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:03 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:03.835929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:03.836541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:03.843422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:03.843942 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:03.844375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:03.845592 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:03.846187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:03.846749 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:04.079368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-8a4ea610-4214-474b-b3e7-327ee8d1485c req-fb7f61b0-7f71-4132-833f-4421625a156a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042b4744-dabc-4cfd-94c3-88306f92216b", "name": "network-vif-deleted", "tag": "b2baf117-366d-4d9f-9194-5fc4e8ba940c"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:04.081831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:04.091915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c62326cd-66c8-4bcc-9581-dd29639c7d1e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 200 len: 1503 microversion: 2.1 time: 0.259450 Nov 02 20:32:04.093780 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 159/318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:03 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:04.100041 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8a4ea610-4214-474b-b3e7-327ee8d1485c req-fb7f61b0-7f71-4132-833f-4421625a156a service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:04.100752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8a4ea610-4214-474b-b3e7-327ee8d1485c req-fb7f61b0-7f71-4132-833f-4421625a156a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:04.101181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8a4ea610-4214-474b-b3e7-327ee8d1485c req-fb7f61b0-7f71-4132-833f-4421625a156a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:04.105630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:04.115879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-8a4ea610-4214-474b-b3e7-327ee8d1485c req-fb7f61b0-7f71-4132-833f-4421625a156a service nova] Creating event network-vif-deleted:b2baf117-366d-4d9f-9194-5fc4e8ba940c for instance 042b4744-dabc-4cfd-94c3-88306f92216b on hv-cinder-86236 Nov 02 20:32:04.123424 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-8a4ea610-4214-474b-b3e7-327ee8d1485c req-fb7f61b0-7f71-4132-833f-4421625a156a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047485 Nov 02 20:32:04.124526 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 160/319] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:32:04.689971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:04.690702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:04.698072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:04.698557 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:04.698984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:04.699731 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:04.700769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:04.700769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:04.704779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:04.829130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:04.836715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6ec91200-07fb-4f1e-b5ab-47ba5f4c35a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.150582 Nov 02 20:32:04.837583 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 160/320] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:04 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:05.122940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:05.123700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 042b4744-dabc-4cfd-94c3-88306f92216b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:05.131786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:05.132297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:05.132772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:05.133520 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:05.134025 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:05.134449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:05.149263 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] HTTP exception thrown: Instance 042b4744-dabc-4cfd-94c3-88306f92216b could not be found. Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Request method failure captured: Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b HTTP/1.1 Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtOvHM1qInDeLYgxclaG78zmZUEmUVwtlkbBRpuQhJKtf3VsKFPOpG2CMmSgXjxFXLKfVqNzWgrdTOle5_P27rJo6fl4cjIWGg4p1VnM5rXnMoA3ZwewCA28bFE2AbFIMMRlL3ves07uzS4UKCkfEHyv7k4Db-kzkygJvaQbpdHFPUk Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 47c08bba480f466dbd6cab623f352d6d Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesActionsTest-2117979825 Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:32:05.151391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47c08bba480f466dbd6cab623f352d6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47c08bba480f466dbd6cab623f352d6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47c08bba480f466dbd6cab623f352d6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47c08bba480f466dbd6cab623f352d6d"}]}] Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesActionsTest-2117979825 Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 47c08bba480f466dbd6cab623f352d6d Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesActionsTest-2117979825 Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesActionsTest-2117979825-project Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: f9fa184d2c7a49819d2b47e47875da00 Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesActionsTest-2117979825-project Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 042b4744-dabc-4cfd-94c3-88306f92216b could not be found. Nov 02 20:32:05.152780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '042b4744-dabc-4cfd-94c3-88306f92216b'} Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042b4744-dabc-4cfd-94c3-88306f92216b could not be found. Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:32:05.153447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042b4744-dabc-4cfd-94c3-88306f92216b could not be found. Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042b4744-dabc-4cfd-94c3-88306f92216b could not be found. Nov 02 20:32:05.154793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:05.156013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Returning 404 to user: Instance 042b4744-dabc-4cfd-94c3-88306f92216b could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:32:05.156013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0034d03a-447f-43b4-93b2-0ad4d2850c45 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b" status: 404 len: 111 microversion: 2.1 time: 0.035450 Nov 02 20:32:05.156013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 161/321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:05 2022] GET /compute/v2.1/servers/042b4744-dabc-4cfd-94c3-88306f92216b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:32:05.253510 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1649642627", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "networks": [{"uuid": "fe9b1c21-4541-4329-93cc-06d411cbc585"}]}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:05.309092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] validate_networks() for [('fe9b1c21-4541-4329-93cc-06d411cbc585', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:32:05.663131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:32:05.663574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:32:05.664076 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:32:05.664479 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:32:05.664924 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:32:05.673512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:05.673987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:05.674413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:05.675133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:05.675585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:05.676104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:05.693092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Getting quotas for project 47c08bba480f466dbd6cab623f352d6d. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:32:05.697130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Getting quotas for user f9fa184d2c7a49819d2b47e47875da00 and project 47c08bba480f466dbd6cab623f352d6d. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:32:05.709263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:32:05.711717 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:32:05.759858 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4f0ec99f-ab74-4d5c-9089-9408e72c9b8f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509992 Nov 02 20:32:05.760536 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 161/322] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 20:32:05.773474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-de9c369c-621a-4839-b3f5-305858d409ff tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:05.774199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-de9c369c-621a-4839-b3f5-305858d409ff tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:05.835745 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-de9c369c-621a-4839-b3f5-305858d409ff tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:05.843086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-de9c369c-621a-4839-b3f5-305858d409ff tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1214 microversion: 2.1 time: 0.073801 Nov 02 20:32:05.843695 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 162/323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:05 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:05.866147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:05.866742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:05.876485 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:05.876973 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:05.877467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:05.878526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:05.878656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:05.879000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:06.021098 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:06.029875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-48420a38-1595-425e-9da3-da698208d276 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.168248 Nov 02 20:32:06.030448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 162/324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:05 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:06.867832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:06.868625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:06.876728 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:06.877369 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:06.877862 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:06.878665 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:06.879153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:06.879768 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:06.951647 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:06.959804 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-725349a8-3777-4a59-98c1-b5dd094e0864 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1266 microversion: 2.1 time: 0.095845 Nov 02 20:32:06.961107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 163/325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:06 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:07.053909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:07.054531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:07.066449 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:07.066956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:07.067411 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:07.068153 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:07.068621 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:07.069033 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:07.452079 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:07.460516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-638b2f4b-d00d-477d-9736-a22327304742 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.410368 Nov 02 20:32:07.461315 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 163/326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:07 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:07.984431 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:07.985034 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:07.992693 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:07.993174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:07.993595 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:07.994288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:07.994731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:07.995306 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:08.148817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:08.158950 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-39c2a299-5d03-466b-8c53-79bd35d346d2 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.178548 Nov 02 20:32:08.172346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 164/327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:07 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:08.484696 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:08.486178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:08.493344 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:08.494320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:08.494952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:08.496021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:08.497295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:08.497905 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:08.702916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:08.712688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4582f324-cf66-46d6-8676-f82fbe26c107 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.231898 Nov 02 20:32:08.713252 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 164/328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:08 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:08.883839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-144de2f5-c768-473a-bec2-91f44169ebac req-c1a249ee-f3d5-4853-bff0-29b75f177037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2976244f-9ab8-443b-a44f-6ef59f1a436f", "tag": "ff4ef097-c9c9-46ff-8bbd-9477c55896b5"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:08.898272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-144de2f5-c768-473a-bec2-91f44169ebac req-c1a249ee-f3d5-4853-bff0-29b75f177037 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:08.899033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-144de2f5-c768-473a-bec2-91f44169ebac req-c1a249ee-f3d5-4853-bff0-29b75f177037 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:08.912788 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-144de2f5-c768-473a-bec2-91f44169ebac req-c1a249ee-f3d5-4853-bff0-29b75f177037 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:08.938001 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-144de2f5-c768-473a-bec2-91f44169ebac req-c1a249ee-f3d5-4853-bff0-29b75f177037 service nova] Creating event network-changed:ff4ef097-c9c9-46ff-8bbd-9477c55896b5 for instance 2976244f-9ab8-443b-a44f-6ef59f1a436f on hv-cinder-86236 Nov 02 20:32:08.952048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-144de2f5-c768-473a-bec2-91f44169ebac req-c1a249ee-f3d5-4853-bff0-29b75f177037 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070171 Nov 02 20:32:08.954174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 165/329] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:32:09.182600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:09.183204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:09.190259 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:09.190959 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:09.191378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:09.192316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:09.192976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:09.193575 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:09.388706 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:09.396783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-14243c2c-aadd-43bf-9878-34197f43c741 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.218015 Nov 02 20:32:09.397357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 165/330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:09 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:09.736819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:09.737506 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:09.744159 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:09.744633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:09.745065 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:09.745745 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:09.746208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:09.746661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:09.881655 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:09.889586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-72129863-2088-4ec2-bb47-c62d65580207 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.156986 Nov 02 20:32:09.890151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 166/331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:09 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:10.421667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:10.422989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:10.429081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:10.429559 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:10.429986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:10.430670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:10.431130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:10.431532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:10.570019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:10.577562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-dad6ac03-871e-4645-a704-cac369eb25cb tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.160779 Nov 02 20:32:10.578136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 166/332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:10 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:10.912944 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:10.913576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:10.921032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:10.921515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:10.921943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:10.922635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:10.923114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:10.923533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:11.255175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:11.262817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-46abba3d-9e3f-4e9a-ba57-5a3865862e81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.353689 Nov 02 20:32:11.263377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 167/333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:10 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:11.600097 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:11.600735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:11.606723 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:11.607205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:11.607662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:11.608357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:11.608811 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:11.609231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:11.746908 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:11.754698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f299febb-80ef-4bbc-a60a-ab449cda60e6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.158475 Nov 02 20:32:11.755266 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 167/334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:11 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:12.286460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:12.286984 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:12.294109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:12.294593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:12.295028 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:12.296008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:12.296469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:12.296894 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:12.425696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:12.433507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f577aa96-9c68-4449-af63-c9dbc7d567e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.151287 Nov 02 20:32:12.439152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 168/335] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:12 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:12.778949 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:12.779740 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:12.785619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:12.786102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:12.786534 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:12.787225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:12.787711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:12.788134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:13.102804 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:13.110450 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f71a4985-b928-423f-9201-d1d610d8da6e tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.335738 Nov 02 20:32:13.111021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 168/336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:12 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:13.458394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:13.460586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:13.470441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:13.471024 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:13.471468 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:13.472201 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:13.472660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:13.473268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:13.650382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:13.663355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-095553aa-e6ec-4ce4-9ac0-67a18b8d608d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.208644 Nov 02 20:32:13.668849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 169/337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:13 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:14.135433 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:14.136145 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:14.143423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:14.144288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:14.144715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:14.145403 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:14.145848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:14.146267 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:14.301849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:14.313011 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-514f1308-ab99-4f23-9fe9-05b76f06a644 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.182594 Nov 02 20:32:14.313585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 169/338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:14 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:14.686953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:14.687552 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:14.693795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:14.694270 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:14.694694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:14.695373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:14.695850 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:14.696264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:14.845846 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:14.853643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6002fbeb-e96f-4c33-a7d3-b4b27bd004f5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.171306 Nov 02 20:32:14.854212 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 170/339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:14 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:15.336849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:15.337461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:15.346651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:15.347133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:15.347563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:15.348494 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:15.349711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:15.350144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:15.485071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:15.492923 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-60e9d512-edec-4cd7-b585-06a2e3fcc425 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.159939 Nov 02 20:32:15.493516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 170/340] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:15 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:15.877901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:15.879072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:15.881719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:15.887931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:15.888699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:15.889382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:15.890308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:15.890965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:15.892397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:15.908379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-b7b7051e-8233-423e-bc1b-5528c59134da req-35e05fc0-98df-4b5f-921e-4d91b54555bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2976244f-9ab8-443b-a44f-6ef59f1a436f", "name": "network-vif-plugged", "status": "completed", "tag": "ff4ef097-c9c9-46ff-8bbd-9477c55896b5"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:15.914437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:15.915296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:15.920795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-b7b7051e-8233-423e-bc1b-5528c59134da req-35e05fc0-98df-4b5f-921e-4d91b54555bb service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:15.921480 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-b7b7051e-8233-423e-bc1b-5528c59134da req-35e05fc0-98df-4b5f-921e-4d91b54555bb service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:15.921911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-b7b7051e-8233-423e-bc1b-5528c59134da req-35e05fc0-98df-4b5f-921e-4d91b54555bb service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:15.935230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-b7b7051e-8233-423e-bc1b-5528c59134da req-35e05fc0-98df-4b5f-921e-4d91b54555bb service nova] Creating event network-vif-plugged:ff4ef097-c9c9-46ff-8bbd-9477c55896b5 for instance 2976244f-9ab8-443b-a44f-6ef59f1a436f on hv-cinder-86236 Nov 02 20:32:15.941640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-b7b7051e-8233-423e-bc1b-5528c59134da req-35e05fc0-98df-4b5f-921e-4d91b54555bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036249 Nov 02 20:32:15.942222 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 171/341] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:32:16.053670 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:16.068194 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6aa78a3b-dadc-4680-842b-1fbd67547597 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.192532 Nov 02 20:32:16.068806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 171/342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:15 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:16.517421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:16.518191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:16.520089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:16.525716 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:16.526188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:16.526610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:16.527920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:16.528377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:16.528786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:16.880265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:16.888523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ffaea692-be11-4c74-ba37-00291b72af88 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.375370 Nov 02 20:32:16.889085 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 172/343] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:16 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:17.092023 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:17.092552 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:17.099271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:17.099800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:17.100234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:17.100930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:17.101385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:17.101831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:17.232606 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:17.240199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-44b0d376-d2b6-4eb3-81ef-98afc530f638 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.152635 Nov 02 20:32:17.240772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 172/344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:17 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:17.911930 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:17.912620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:17.918789 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:17.919368 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:17.919898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:17.920670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:17.921192 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:17.921688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:18.054933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:18.063593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-520d74d2-e7c2-41c1-989e-8a87753b477f tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1314 microversion: 2.1 time: 0.155324 Nov 02 20:32:18.064430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 173/345] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:17 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:18.266955 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:18.267553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:18.273422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:18.273892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:18.274314 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:18.274986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:18.275428 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:18.275869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:18.419400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:18.427224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0e162d47-a944-4b22-896a-c68d5a14d93d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.165267 Nov 02 20:32:18.428206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 173/346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:18 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:19.090831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:19.091409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:19.097215 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:19.097688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:19.098114 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:19.098791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:19.099236 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:19.099684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:19.234043 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:19.241862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6628a6f7-da53-4eea-b9e0-b8dcf4e32baa tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1499 microversion: 2.1 time: 0.155587 Nov 02 20:32:19.242512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 174/347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:19 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:19.453305 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:19.454249 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:19.462669 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:19.463288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:19.464081 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:19.465204 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:19.465923 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:19.466468 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:19.601399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:19.610457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3ea606a8-f6c1-48ca-a35a-0c8f1a19e7ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.161885 Nov 02 20:32:19.611044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 174/348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:19 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:20.411077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:20.411719 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:20.418564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:20.419357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:20.419832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:20.420529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:20.421016 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:20.421473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:20.447713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:32:20.531418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9e8c5031-479a-466f-957d-7efbecd30144 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 204 len: 0 microversion: 2.1 time: 0.123961 Nov 02 20:32:20.532273 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 175/349] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:32:20 2022] DELETE /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:32:20.540608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:20.541708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:20.549137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:20.549819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:20.550242 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:20.550938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:20.551384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:20.551865 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:20.634042 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:20.634808 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:20.641126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:20.641610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:20.642040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:20.643794 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:20.644375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:20.644870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:20.668599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:20.694084 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:20.703512 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cb1f63ae-fac6-4be7-8ab8-f32b2b1e79c0 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1505 microversion: 2.1 time: 0.166862 Nov 02 20:32:20.707651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 175/350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:20 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:20.789072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:20.797226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-83a2a9aa-df01-4425-b588-2b03a398234c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.167758 Nov 02 20:32:20.798195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 176/351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:20 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:21.727925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:21.728545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:21.735104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:21.735582 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:21.736052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:21.736742 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:21.737195 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:21.737614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:21.820992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:21.821597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:21.828829 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:21.829311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:21.829742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:21.830436 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:21.830889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:21.831346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:21.868462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:21.876252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-04a2bd6c-b6b3-498d-8165-974915fd1c1d tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1505 microversion: 2.1 time: 0.152265 Nov 02 20:32:21.876829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 176/352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:21 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:21.969415 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:21.977020 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-88bfd9f2-978a-4327-8b70-9c850311eb8a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.159806 Nov 02 20:32:21.977734 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 177/353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:21 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:22.899552 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:22.900177 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:22.907361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:22.907873 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:22.908293 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:22.908980 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:22.909422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:22.909832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:23.002926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:23.003533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:23.009854 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:23.010744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:23.012088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:23.013768 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:23.014817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:23.015521 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:23.060950 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:23.068736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ebe8b905-c042-41a1-9015-94a51b5accb6 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1505 microversion: 2.1 time: 0.173261 Nov 02 20:32:23.069233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 177/354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:22 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:23.207105 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:23.215151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-56d9c2bf-f17a-4d2f-acb4-7fc821d68329 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1523 microversion: 2.1 time: 0.218944 Nov 02 20:32:23.215753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 178/355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:22 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:24.091812 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:24.092465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:24.093317 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-b449eddc-43e9-4e3c-b868-2dcdf39ff922 req-d6a03014-ad3d-4eac-b752-372ab26c6e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2976244f-9ab8-443b-a44f-6ef59f1a436f", "name": "network-vif-deleted", "tag": "ff4ef097-c9c9-46ff-8bbd-9477c55896b5"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:24.099078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:24.099674 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:24.100177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:24.100953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:24.101469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:24.101903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:24.107290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-b449eddc-43e9-4e3c-b868-2dcdf39ff922 req-d6a03014-ad3d-4eac-b752-372ab26c6e51 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:24.107881 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-b449eddc-43e9-4e3c-b868-2dcdf39ff922 req-d6a03014-ad3d-4eac-b752-372ab26c6e51 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:24.108300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-b449eddc-43e9-4e3c-b868-2dcdf39ff922 req-d6a03014-ad3d-4eac-b752-372ab26c6e51 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:24.138319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-b449eddc-43e9-4e3c-b868-2dcdf39ff922 req-d6a03014-ad3d-4eac-b752-372ab26c6e51 service nova] Creating event network-vif-deleted:ff4ef097-c9c9-46ff-8bbd-9477c55896b5 for instance 2976244f-9ab8-443b-a44f-6ef59f1a436f on hv-cinder-86236 Nov 02 20:32:24.145239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-b449eddc-43e9-4e3c-b868-2dcdf39ff922 req-d6a03014-ad3d-4eac-b752-372ab26c6e51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057745 Nov 02 20:32:24.146166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 178/356] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:32:24.170368 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9fa184d2c7a49819d2b47e47875da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c08bba480f466dbd6cab623f352d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:24.179422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a40110dc-4f8c-43b5-8a15-5e3476f41407 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 200 len: 1463 microversion: 2.1 time: 0.091846 Nov 02 20:32:24.180479 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 179/357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:24 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:24.244329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:24.245231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:24.253991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:24.254559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:24.255151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:24.256017 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:24.256501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:24.257042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:24.412010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:24.422430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6124f712-f6b5-444e-8307-0fc4e463390e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1503 microversion: 2.1 time: 0.182630 Nov 02 20:32:24.423196 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 179/358] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:24 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:24.447226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:24.447226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:24.453143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:24.453619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:24.454041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:24.454723 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:24.455204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:24.455633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:24.597022 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:24.604689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5f9e7455-cf63-40a6-b13b-df8cb7aa2572 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1515 microversion: 2.1 time: 0.163385 Nov 02 20:32:24.605859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 180/359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:24 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:25.203348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:25.204104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] [instance: 2976244f-9ab8-443b-a44f-6ef59f1a436f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:25.212993 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:25.213588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:25.214111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:25.215408 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:25.215971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:25.216557 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:25.232079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] HTTP exception thrown: Instance 2976244f-9ab8-443b-a44f-6ef59f1a436f could not be found. Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Request method failure captured: Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f HTTP/1.1 Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtOvHM1qInDeLYgxclaG78zmZUEmUVwtlkbBRpuQhJKtf3VsKFPOpG2CMmSgXjxFXLKfVqNzWgrdTOle5_P27rJo6fl4cjIWGg4p1VnM5rXnMoA3ZwewCA28bFE2AbFIMMRlL3ves07uzS4UKCkfEHyv7k4Db-kzkygJvaQbpdHFPUk Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 47c08bba480f466dbd6cab623f352d6d Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesActionsTest-2117979825 Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:32:25.233854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47c08bba480f466dbd6cab623f352d6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47c08bba480f466dbd6cab623f352d6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47c08bba480f466dbd6cab623f352d6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47c08bba480f466dbd6cab623f352d6d"}]}] Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesActionsTest-2117979825 Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 47c08bba480f466dbd6cab623f352d6d Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesActionsTest-2117979825 Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesActionsTest-2117979825-project Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: f9fa184d2c7a49819d2b47e47875da00 Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesActionsTest-2117979825-project Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 2976244f-9ab8-443b-a44f-6ef59f1a436f could not be found. Nov 02 20:32:25.235390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '2976244f-9ab8-443b-a44f-6ef59f1a436f'} Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2976244f-9ab8-443b-a44f-6ef59f1a436f could not be found. Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:32:25.236328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2976244f-9ab8-443b-a44f-6ef59f1a436f could not be found. Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2976244f-9ab8-443b-a44f-6ef59f1a436f could not be found. Nov 02 20:32:25.237769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:25.239677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] Returning 404 to user: Instance 2976244f-9ab8-443b-a44f-6ef59f1a436f could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:32:25.239677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bd49f232-1669-4672-81c8-6bf294f9b637 tempest-VolumesActionsTest-2117979825 tempest-VolumesActionsTest-2117979825-project] 10.222.0.26 "GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f" status: 404 len: 111 microversion: 2.1 time: 0.037677 Nov 02 20:32:25.239677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 180/360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:25 2022] GET /compute/v2.1/servers/2976244f-9ab8-443b-a44f-6ef59f1a436f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 20:32:26.046812 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:26.049183 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:26.055531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:26.056053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:26.056483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:26.057171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:26.057618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:26.058034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:26.081774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lazy-loading 'flavor' on Instance uuid 80aa0a2a-951c-4113-b7df-d2d32b966e13 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:32:26.190770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-78db6162-127e-425d-b11b-2e7e6366a4ca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13/action" status: 200 len: 32 microversion: 2.1 time: 0.148253 Nov 02 20:32:26.191509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 181/361] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:32:26 2022] POST /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:32:26.203787 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:26.204520 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:26.212468 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:26.212957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:26.213391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:26.214088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:26.214605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:26.215217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:26.219835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:26.352187 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:26.360754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5b7324e1-892f-46e2-b4a8-62b331458b21 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.162286 Nov 02 20:32:26.361321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 181/362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:26 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:27.384009 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:27.384712 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:27.391105 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:27.391580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:27.392033 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:27.392735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:27.393181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:27.393589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:27.527460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:27.534968 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5bbafd5c-0b2d-4f8a-9d55-db26494286a7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.155200 Nov 02 20:32:27.535531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 182/363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:27 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:28.558107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:28.558780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:28.565559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:28.566465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:28.566465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:28.567192 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:28.567763 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:28.568206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:28.697150 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:28.705243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-65809763-9370-4d8a-92fc-bbcd23c940a9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.150954 Nov 02 20:32:28.705802 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 182/364] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:28 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:29.728819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:29.729430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:29.736752 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:29.737234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:29.737666 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:29.738358 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:29.738810 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:29.739230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:29.870398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:29.878397 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-74ea4151-e82f-4c94-a1d8-da898b093ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.153594 Nov 02 20:32:29.878988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 183/365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:29 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:30.908590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:30.909234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:30.915888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:30.916366 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:30.916803 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:30.917486 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:30.918443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:30.918856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:31.047954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:31.055533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fc54a5d6-1bc4-4657-9751-02874e83bc52 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.150776 Nov 02 20:32:31.056135 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 183/366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:30 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:32.078360 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:32.078961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:32.085492 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:32.085963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:32.086388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:32.087064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:32.087506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:32.087956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:32.227818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:32.235660 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ff275cdf-1054-48c1-899e-94f7433737c7 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.161164 Nov 02 20:32:32.236217 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 184/367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:32 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:33.258481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:33.259096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:33.261002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=54 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:33.267941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:33.268655 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:33.269087 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:33.269782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:33.270266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:33.270683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:33.411908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:33.419708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dbc7fbfe-1cb4-43aa-8ffa-f92ea5a4ccde tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.165207 Nov 02 20:32:33.420314 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 184/368] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:33 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:34.443518 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:34.444226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:34.450574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:34.451373 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:34.452006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:34.452879 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:34.453144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:34.453565 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:34.590473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:34.600766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e761b965-7e22-44b8-8a89-f84f0935306b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.161323 Nov 02 20:32:34.601413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 185/369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:34 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:35.639893 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:35.643787 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:35.661453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:35.661453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:35.661453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:35.662057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:35.662533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:35.663710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:35.810308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:35.822008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a04bf76b-bd7d-4c9e-844d-987873f961ba tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.198547 Nov 02 20:32:35.823420 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 185/370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:35 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:36.849260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:36.850504 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:36.859087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:36.859693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:36.860454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:36.861232 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:36.861934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:36.862351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:37.027322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:37.037085 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4e13058e-cd4d-4a15-968c-add61faf5310 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.192938 Nov 02 20:32:37.037753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 186/371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:36 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:38.063296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:38.064120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:38.070767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:38.071252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:38.071939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:38.072660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:38.073541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:38.075102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:38.224713 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:38.233807 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3319a4b6-3d0e-4a3e-aa35-f67eebb4f280 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.176276 Nov 02 20:32:38.247668 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 186/372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:38 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:39.257797 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:39.258364 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:39.264560 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:39.265121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:39.265622 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:39.266385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:39.266844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:39.267268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:39.406146 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:39.414159 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-59a42f67-ff25-476a-a2ab-a387868f28d1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.160336 Nov 02 20:32:39.415036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 187/373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:39 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:40.438772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:40.439380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:40.446510 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:40.447137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:40.447631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:40.448394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:40.449760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:40.450456 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:40.591736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:40.601247 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2d324466-1531-4106-911a-d9118ba7e43c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.166299 Nov 02 20:32:40.602105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 187/374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:40 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:41.626407 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:41.627014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:41.634665 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:41.635565 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:41.636193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:41.636948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:41.637454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:41.637821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:41.771720 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:41.780130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d6118143-de21-4479-b031-b0e8cccbe86e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.157990 Nov 02 20:32:41.780810 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 188/375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:41 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:42.805954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:42.806400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:42.816601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:42.817879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:42.820721 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:42.821928 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:42.825046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:42.825610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:42.967859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:42.976850 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d2add874-827e-44cf-a6c7-5d50cee33f5b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.176064 Nov 02 20:32:42.977423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 188/376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:42 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:44.000467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:44.001043 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:44.008593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:44.009074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:44.009734 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:44.010876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:44.011340 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:44.011834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:44.162728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:44.171347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8fd99772-609f-499e-947c-203a69489f43 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.175588 Nov 02 20:32:44.171962 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 189/377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:43 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:45.196884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:45.198214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:45.205094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:45.205852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:45.206353 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:45.207296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:45.207793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:45.208222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:45.361509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:45.374282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-acc177ca-a75a-4fc0-99d7-7a6815a63a25 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.181214 Nov 02 20:32:45.375448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 189/378] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:45 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:46.397866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:46.398707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:46.405150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:46.405627 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:46.406055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:46.406736 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:46.407353 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:46.407811 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:46.555155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:46.563476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7bdbc86e-ecd9-422c-b7e6-ec3d0fe16c6a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.169281 Nov 02 20:32:46.564159 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 190/379] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:46 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:47.587472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:47.588155 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:47.595005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:47.595475 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:47.595940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:47.596630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:47.597078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:47.597501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:47.737282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:47.746146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6bb348bb-438b-40b5-991b-6cd20cd07801 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.161968 Nov 02 20:32:47.762462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 190/380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:47 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:48.769936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:48.770558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:48.772828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:48.779838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:48.780541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:48.781004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:48.782063 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:48.782559 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:48.783354 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:48.789797 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:48.950334 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:48.958806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-af663e93-f579-4be8-9c39-290a4c7e38ac tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.192660 Nov 02 20:32:48.959670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 191/381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:48 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:49.982930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:49.984301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:49.992062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:49.992616 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:49.993132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:49.993832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:49.994282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:49.994703 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:50.169956 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:50.183405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b46a7c90-f262-4034-9898-a46ae30951e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.204503 Nov 02 20:32:50.184567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 191/382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:49 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:51.208984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:51.209603 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:51.216417 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:51.216907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:51.217340 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:51.218047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:51.218499 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:51.218920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:51.379395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:51.388009 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e2f27bb5-fb47-4142-b0e7-b0e39412ef3e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.182899 Nov 02 20:32:51.388576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 192/383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:51 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:52.410121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:52.410725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:52.417567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:52.418071 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:52.418534 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:52.419210 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:52.419672 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:52.420087 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:52.555340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:52.563825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-706f1b5a-bb69-4d91-94d2-5ca3450ad30e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.157473 Nov 02 20:32:52.564387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 192/384] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:52 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:53.586192 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:53.587388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:53.594478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.594971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.595412 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:53.596139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.596595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.597016 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:53.738758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:53.746821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-95eef697-d53d-4083-aaee-bfa3ec72ac50 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1501 microversion: 2.1 time: 0.164697 Nov 02 20:32:53.747391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 193/385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:53 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:53.769300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "132f5494-1258-4c33-b873-59559920ab9d"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:53.771842 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:53.778242 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.778716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.779140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:53.779847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.780297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.780706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:53.802919 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] HTTP exception thrown: Cannot 'attach_volume' instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 while it is in vm_state rescued Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Request method failure captured: Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: POST /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13/os-volume_attachments HTTP/1.1 Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 74 Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNm3Ia54Ecc6_2q4iCCrD28VHkW9NorsS5mgwEf8Y1PPgT1jkebRfgAJN4xzUM_eYdsb2zKz48R7rFcQ6JnNZC6DPQrIaxiP9XnWl_bZCaCHzZ6ORqjwVTfcHqipPR09B21n96vCb3ZgnqAuPtDJK9FuFeLcrBKosvRc1d8dBT7kpw Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:32:53.804507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}] Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 8fd4a5629fff47a69cf26196dbdee674 Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {"volumeAttachment": {"volumeId": "132f5494-1258-4c33-b873-59559920ab9d"}} Nov 02 20:32:53.805983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Cannot 'attach_volume' instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 while it is in vm_state rescued Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'server_id': '80aa0a2a-951c-4113-b7df-d2d32b966e13', 'body': {'volumeAttachment': {'volumeId': '132f5494-1258-4c33-b873-59559920ab9d'}}} Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:32:53.806869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 while it is in vm_state rescued Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:32:53.808925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:32:53.810566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:32:53.810566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:32:53.810566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 while it is in vm_state rescued Nov 02 20:32:53.810566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:32:53.810566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Returning 409 to user: Cannot 'attach_volume' instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 while it is in vm_state rescued {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:32:53.810566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-33d0b98b-9d4b-41e5-91df-30d755944d02 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040545 Nov 02 20:32:53.810566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 193/386] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:32:53 2022] POST /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 20:32:53.815981 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:32:53.816507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:53.822186 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.822660 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.823095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:53.824355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.824801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.825229 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:53.891943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e9738774-c196-461b-8010-ff82c2e69efd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13/action" status: 202 len: 0 microversion: 2.1 time: 0.079532 Nov 02 20:32:53.895296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 194/387] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:32:53 2022] POST /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:32:53.901486 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:53.902405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:53.908600 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.909305 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.909885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:53.910825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:53.911554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:53.912144 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:54.061034 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:54.069449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-12ce897c-cd66-45d1-9cd3-cbb0ae3d35b2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1509 microversion: 2.1 time: 0.171803 Nov 02 20:32:54.070152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 194/388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:53 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:32:55.096810 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:55.097572 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:55.103577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:55.104108 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:55.105184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:55.105949 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:55.106417 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:55.106876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:55.256248 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:55.264316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2c56fd1a-c950-431f-9495-95324f06782f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1509 microversion: 2.1 time: 0.171823 Nov 02 20:32:55.264870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 195/389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:55 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:56.302279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:56.302930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:56.310603 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:56.311111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:56.311591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:56.312302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:56.312792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:56.313285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:56.315910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=81 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:56.449368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:56.457026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1ef7a948-8f82-43d1-af02-4914efe52252 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1509 microversion: 2.1 time: 0.158714 Nov 02 20:32:56.457773 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 195/390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:56 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:32:57.482354 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:32:57.482861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:32:57.488742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:57.489210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:57.489638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:57.490327 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:32:57.490772 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:32:57.491178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:32:57.625800 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:32:57.633450 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-89cbade3-d351-4625-bbee-39b7cd859abf tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1515 microversion: 2.1 time: 0.155718 Nov 02 20:32:57.634031 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 196/391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:32:57 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:08.491698 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8e567c65-d52f-4a27-a726-444749304c6d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'create', calling method: .version_select at 0x7f2e223043a0>, body: {"keypair": {"name": "tempest-keypair-2139070807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExi8hrUDQbPa7rBAGC3spv1r+hlQubYIhWreMX0izDa804Fk6BHOnq5iHv6y+/zmdYQG0JaCnoExLOCKbFMohe/QDCzxUdBowRYrQuGlB0UTri2e+022GwAGxSC/L4Qkg=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:08.497698 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=23 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:08.499264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=5 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:08.512612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-8e567c65-d52f-4a27-a726-444749304c6d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:33:08.517766 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-8e567c65-d52f-4a27-a726-444749304c6d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for user 8fd4a5629fff47a69cf26196dbdee674 and project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:33:08.540805 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8e567c65-d52f-4a27-a726-444749304c6d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053158 Nov 02 20:33:08.547213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 196/392] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:33:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:33:09.825927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1215787731", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8d241b6-91fd-447f-9430-f03282f71e74"}], "security_groups": [{"name": "tempest-securitygroup--855471456"}], "key_name": "tempest-keypair-2139070807", "user_data": "}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:09.835015 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=11 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:09.835684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:09.930524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] validate_networks() for [('b8d241b6-91fd-447f-9430-f03282f71e74', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:33:10.301943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:33:10.302360 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:33:10.302822 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:33:10.303249 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:33:10.303671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:33:10.313284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:10.313756 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:10.314184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:10.314902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:10.315369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:10.315848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:10.332395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:33:10.336295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Getting quotas for user 8fd4a5629fff47a69cf26196dbdee674 and project 7e75c5cf78474dfcb3c56cdaa26e9d44. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:33:10.347124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:33:10.349405 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:33:10.396052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1a84a10a-d951-43e4-838c-063ef3f76c49 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.574295 Nov 02 20:33:10.396706 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 197/393] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:33:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:33:10.408591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-84e3d5da-53f7-4d50-9153-f035b161bdc0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:10.409380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-84e3d5da-53f7-4d50-9153-f035b161bdc0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:10.466816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-84e3d5da-53f7-4d50-9153-f035b161bdc0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:10.474329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-84e3d5da-53f7-4d50-9153-f035b161bdc0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1246 microversion: 2.1 time: 0.070123 Nov 02 20:33:10.474868 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 197/394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:10 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:11.497612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:11.498822 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:11.504773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:11.505244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:11.505668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:11.506344 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:11.506788 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:11.507204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:11.569376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:11.578119 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-738aeba7-8d59-4550-83c2-9dbce4833ac5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1250 microversion: 2.1 time: 0.084631 Nov 02 20:33:11.578670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 198/395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:11 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:12.600935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:12.601539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:12.609406 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:12.609889 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:12.610321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:12.611019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:12.611477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:12.611927 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:12.672021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:12.679607 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-da662583-b689-46ff-8257-7974f2e53704 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1242 microversion: 2.1 time: 0.082530 Nov 02 20:33:12.680190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 198/396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:12 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:13.706631 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:13.708508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:13.734058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:13.736886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:13.738746 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:13.739722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:13.742510 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:13.744030 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:13.831805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:13.840533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-93659652-49fe-45e0-9601-1396ff0b5a4f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1304 microversion: 2.1 time: 0.141807 Nov 02 20:33:13.841225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 199/397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:13 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:14.865409 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:14.866051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:14.872475 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:14.872903 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:14.873345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:14.874035 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:14.875104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:14.875530 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:15.004464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:15.012069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ffda491e-6253-47bc-98f0-0efc04c8b783 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.150502 Nov 02 20:33:15.012631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 199/398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:14 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:16.035450 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:16.036117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:16.041982 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:16.042461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:16.042920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:16.043604 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:16.044080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:16.044502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:16.168701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:16.176869 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-48134480-6eff-4c0f-8dd6-499852f72460 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.145471 Nov 02 20:33:16.177437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 200/399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:16 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:17.199959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:17.200570 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:17.207313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:17.207828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:17.208261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:17.208942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:17.209390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:17.209807 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:17.337317 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:17.344938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-96c01039-f930-4649-9848-85e20b51b9f9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.148765 Nov 02 20:33:17.345498 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 200/400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:17 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:18.368816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:18.369437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:18.376444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:18.376965 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:18.377400 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:18.378101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:18.378558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:18.378981 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:18.691465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:18.699707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-30b078ca-9342-4221-9341-52d7da653b12 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.335212 Nov 02 20:33:18.700366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 201/401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:18 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:18.929792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-7303d626-db43-45ae-a790-1228ed84707d req-86e346ec-08e0-420d-b6bf-e759eb7296c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6199abf-c24b-4e3a-acda-9231911771b6", "tag": "78c4d4e5-765c-435d-b699-2638d18df952"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:18.943571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7303d626-db43-45ae-a790-1228ed84707d req-86e346ec-08e0-420d-b6bf-e759eb7296c6 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:18.944123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7303d626-db43-45ae-a790-1228ed84707d req-86e346ec-08e0-420d-b6bf-e759eb7296c6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:18.944638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7303d626-db43-45ae-a790-1228ed84707d req-86e346ec-08e0-420d-b6bf-e759eb7296c6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:18.959011 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-7303d626-db43-45ae-a790-1228ed84707d req-86e346ec-08e0-420d-b6bf-e759eb7296c6 service nova] Creating event network-changed:78c4d4e5-765c-435d-b699-2638d18df952 for instance a6199abf-c24b-4e3a-acda-9231911771b6 on hv-cinder-86236 Nov 02 20:33:18.963665 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-7303d626-db43-45ae-a790-1228ed84707d req-86e346ec-08e0-420d-b6bf-e759eb7296c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037973 Nov 02 20:33:18.964481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 201/402] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:33:19.723655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:19.724392 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:19.730584 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:19.731194 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:19.731743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:19.732561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:19.733105 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:19.734464 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:19.863349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:19.870910 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9af74638-15a6-471a-8250-28aaf2b81fca tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.151242 Nov 02 20:33:19.871558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 202/403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:19 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:20.892101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=6 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:20.896329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:20.897024 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:20.903380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:20.903870 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:20.904294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:20.904970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:20.906026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:20.906469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:21.059219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:21.068477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a38d0e46-1f5b-497e-871b-c2133f63205a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.178289 Nov 02 20:33:21.069245 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 202/404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:20 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:22.094305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:22.094834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:22.096666 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:22.097336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:22.103701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:22.104172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:22.104595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:22.105273 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:22.105718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:22.106132 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:22.233388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:22.241634 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7ea11d04-2355-4f5b-b2fd-21fad24050db tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.151874 Nov 02 20:33:22.242198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 203/405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:22 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:23.264279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:23.264892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:23.271800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:23.272340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:23.272774 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:23.273519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:23.274198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:23.274622 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:23.411199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:23.419374 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cbd7dcd8-6a81-43a9-bb86-c0d432f89ab2 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.159086 Nov 02 20:33:23.420083 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 203/406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:23 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:33:24.444137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:24.445591 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:24.458855 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:24.459590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:24.460049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:24.460758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:24.461212 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:24.461635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:24.659774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:24.667564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f5c7f0a3-d1a2-4b94-81b6-2f682df9f997 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.227284 Nov 02 20:33:24.668172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 204/407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:24 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:33:25.690835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:25.691382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:25.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:25.698818 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:25.699250 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:25.700002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:25.700460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:25.701083 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:25.852125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:25.861335 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8a37c4e7-400f-4f77-9e3c-1d35ca4f25a1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.174381 Nov 02 20:33:25.862213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 204/408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:25 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:25.879793 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-06c0e910-d6c1-47e9-82fa-60281f171c25 req-d43a2181-14f5-40ac-8c36-2dc2d4917794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6199abf-c24b-4e3a-acda-9231911771b6", "name": "network-vif-plugged", "status": "completed", "tag": "78c4d4e5-765c-435d-b699-2638d18df952"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:25.890372 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-06c0e910-d6c1-47e9-82fa-60281f171c25 req-d43a2181-14f5-40ac-8c36-2dc2d4917794 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:25.890841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-06c0e910-d6c1-47e9-82fa-60281f171c25 req-d43a2181-14f5-40ac-8c36-2dc2d4917794 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:25.891264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-06c0e910-d6c1-47e9-82fa-60281f171c25 req-d43a2181-14f5-40ac-8c36-2dc2d4917794 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:25.903240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-06c0e910-d6c1-47e9-82fa-60281f171c25 req-d43a2181-14f5-40ac-8c36-2dc2d4917794 service nova] Creating event network-vif-plugged:78c4d4e5-765c-435d-b699-2638d18df952 for instance a6199abf-c24b-4e3a-acda-9231911771b6 on hv-cinder-86236 Nov 02 20:33:25.908793 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-06c0e910-d6c1-47e9-82fa-60281f171c25 req-d43a2181-14f5-40ac-8c36-2dc2d4917794 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032666 Nov 02 20:33:25.909384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 205/409] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:33:26.883933 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:26.884544 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:26.891736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:26.892213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:26.892641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:26.893327 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:26.893778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:26.894201 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:27.022805 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:27.031324 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-73e29063-01dd-446c-8498-fdc772daac53 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.150532 Nov 02 20:33:27.032298 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 205/410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:26 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:28.055482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:28.056129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:28.062683 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:28.063164 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:28.063599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:28.064322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:28.064776 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:28.065199 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:28.194509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:28.202035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-55574c02-741b-4477-b35b-6c62d7c4812a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.150906 Nov 02 20:33:28.202605 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 206/411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:28 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:29.224437 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:29.225075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:29.231446 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:29.231944 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:29.232369 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:29.233060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:29.233487 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:29.233902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:29.360096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:29.368182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-da0ea027-fc98-4e69-93b2-1a12380f9e66 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.147671 Nov 02 20:33:29.368752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 206/412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:29 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:30.390272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:30.390877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:30.397275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:30.397742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:30.398168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:30.398839 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:30.399281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:30.399716 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:30.528520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:30.536155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f63f3f43-c201-47d9-9f9f-ee7a8f8f915e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.149759 Nov 02 20:33:30.536712 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 207/413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:30 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:31.558254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:31.558856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:31.565658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:31.566153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:31.566607 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:31.567284 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:31.567761 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:31.568202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:31.698676 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:31.706970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b6228552-3aae-46cc-a25d-55b367ea9220 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1371 microversion: 2.1 time: 0.152439 Nov 02 20:33:31.707644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 207/414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:31 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:32.730771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:32.731378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:32.737404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:32.738090 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:32.738585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:32.739279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:32.739771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:32.740181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:32.868535 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:32.876051 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a7765a5e-7507-488e-8201-2edb38177b4b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1565 microversion: 2.1 time: 0.149716 Nov 02 20:33:32.876611 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 208/415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:32 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:32.899495 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:32.900057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:32.906349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:32.906824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:32.907250 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:32.907962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:32.908407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:32.908819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:32.987161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dcc0d6e7-e44c-4115-8eee-e36206177d63 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091422 Nov 02 20:33:32.988013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 208/416] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:33:32 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:33:33.904633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-ee2cd200-de38-4092-a084-f8ace69f347d req-01d5d30f-da05-43e2-9382-77dd88bae449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6199abf-c24b-4e3a-acda-9231911771b6", "tag": "78c4d4e5-765c-435d-b699-2638d18df952"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:33.913848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ee2cd200-de38-4092-a084-f8ace69f347d req-01d5d30f-da05-43e2-9382-77dd88bae449 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:33.914322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ee2cd200-de38-4092-a084-f8ace69f347d req-01d5d30f-da05-43e2-9382-77dd88bae449 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:33.914741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ee2cd200-de38-4092-a084-f8ace69f347d req-01d5d30f-da05-43e2-9382-77dd88bae449 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:33.927425 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-ee2cd200-de38-4092-a084-f8ace69f347d req-01d5d30f-da05-43e2-9382-77dd88bae449 service nova] Creating event network-changed:78c4d4e5-765c-435d-b699-2638d18df952 for instance a6199abf-c24b-4e3a-acda-9231911771b6 on hv-cinder-86236 Nov 02 20:33:33.932568 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-ee2cd200-de38-4092-a084-f8ace69f347d req-01d5d30f-da05-43e2-9382-77dd88bae449 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031460 Nov 02 20:33:33.933154 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 209/417] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:33:42.954098 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:42.954841 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=60 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:42.959625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:42.960115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:42.967822 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:42.968301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:42.968732 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:42.969418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:42.969872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:42.970293 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:42.993736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-777fee62-7864-4c6d-82a8-8450a42dda41 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/ips" status: 200 len: 146 microversion: 2.1 time: 0.041153 Nov 02 20:33:42.994246 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 209/418] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:33:42 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:33:46.202296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 20:33:46.202777 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Wed Nov 2 20:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 20:33:46.203567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:46.204305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=66 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:46.208924 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "814ac883-38d0-47a0-9c61-d59bce716bf7"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:46.211302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:46.219598 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:46.220089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:46.220514 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:46.221193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:46.221639 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:46.222053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:46.522244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a0d08f51-dd5c-4b8d-b215-767d08c83a94 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320915 Nov 02 20:33:46.522983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 210/419] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:33:46 2022] POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:33:46.829673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:46.830208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:46.836664 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:46.837137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:46.837561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:46.838231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:46.838678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:46.839147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:46.861484 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b3c042bf-08d2-4b83-bd30-d1efe767c1cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/ips" status: 200 len: 151 microversion: 2.20 time: 0.035697 Nov 02 20:33:46.862062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 210/420] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Nov 2 20:33:46 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:33:49.731736 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:49.732355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:49.739531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:49.740299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:49.740767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:49.741624 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:49.742074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:49.742494 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:49.765785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lazy-loading 'flavor' on Instance uuid 6257b48a-e22b-448d-a9be-458c3c9517c9 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:33:49.951213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1c02878e-fa01-4ce5-8281-5758ad1e7760 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/action" status: 202 len: 0 microversion: 2.20 time: 0.223460 Nov 02 20:33:49.952005 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 211/421] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Nov 2 20:33:49 2022] POST /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:33:49.960266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:49.960806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:49.967575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:49.968082 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:49.968505 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:49.969222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:49.969675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:49.970092 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:50.111410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:50.120064 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:50.121496 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:50.122648 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7aad06a5-f1ab-463c-8227-9e6056a5299b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.166314 Nov 02 20:33:50.123205 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 211/422] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:49 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:51.149229 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:51.149943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:51.156925 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:51.157401 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:51.157827 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:51.158507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:51.158948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:51.159360 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:51.287540 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:51.295508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:51.296957 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:51.298093 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f4428b24-841f-44b8-928a-d0a022a1c632 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.153652 Nov 02 20:33:51.298667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 212/423] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:51 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:52.325156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:52.325750 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:52.333382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:52.333917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:52.334410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:52.335114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:52.335667 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:52.336203 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:52.482214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:52.491280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:52.492911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:52.494065 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-561d3933-f622-4984-bc43-01eaaeb3be83 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.172806 Nov 02 20:33:52.494613 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 212/424] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:52 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:53.522401 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:53.523236 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:53.529819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:53.530297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:53.530728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:53.531421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:53.531964 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:53.532419 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:53.663334 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:53.671743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:53.673203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:53.674392 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-729de8f9-95fb-41e2-8e73-27200845b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.157876 Nov 02 20:33:53.674940 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 213/425] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:53 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:54.700855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:54.701545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:54.708923 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:54.709403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:54.709834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:54.710517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:54.710969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:54.711387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:54.841554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:54.849680 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:54.851101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:54.852316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-457b849f-75f9-4cec-88c6-c73d4cb5d2c8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.155370 Nov 02 20:33:54.852870 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 213/426] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:54 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:55.115209 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-06a76fc4-7ad3-4962-9930-6c67fb253721 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:55.121539 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-06a76fc4-7ad3-4962-9930-6c67fb253721 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:55.122012 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-06a76fc4-7ad3-4962-9930-6c67fb253721 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:55.122439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-06a76fc4-7ad3-4962-9930-6c67fb253721 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:55.182428 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-06a76fc4-7ad3-4962-9930-6c67fb253721 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Going to try to stop instance {{(pid=118986) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 20:33:55.224810 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-06a76fc4-7ad3-4962-9930-6c67fb253721 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action" status: 202 len: 0 microversion: 2.1 time: 0.113761 Nov 02 20:33:55.225398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 214/427] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:33:55 2022] POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:33:55.233348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:55.233961 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:55.240776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:55.241339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:55.241784 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:55.242569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:55.243027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:55.243464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:55.570453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:55.578589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c84533e2-cb47-4795-b929-6621a110f812 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.349030 Nov 02 20:33:55.579154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 214/428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:55 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:55.878590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:55.879278 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:55.885323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:55.885791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:55.886214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:55.886889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:55.887333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:55.887773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:56.019014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:56.028210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:56.029638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:56.030779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-080cfca2-639f-45e9-bd8d-60c76040d5eb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.156634 Nov 02 20:33:56.031330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 215/429] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:55 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:56.602550 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:56.603150 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:56.609501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:56.609976 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:56.610397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:56.611072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:56.611518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:56.611962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:56.740887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:56.748997 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1c1e0f49-92de-4b31-8710-41da0e1e9ca5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.150322 Nov 02 20:33:56.749577 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 215/430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:56 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:57.056405 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:57.057002 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:57.063401 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:57.063904 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:57.064332 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:57.065004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:57.065447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:57.065857 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:57.197088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:57.204910 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:57.206322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:57.207973 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-552d6635-db90-4dd3-a24c-a2123830bc18 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.155392 Nov 02 20:33:57.208524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 216/431] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:57 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:57.773229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:57.773829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:57.780214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:57.780689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:57.781111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:57.781790 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:57.782236 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:57.782653 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:57.908778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:57.916924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4268a5bb-83f4-42e3-9042-570bb8f152a5 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.148231 Nov 02 20:33:57.917481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 216/432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:57 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:58.233839 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:58.234460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:58.241368 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:58.241838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:58.242260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:58.242937 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:58.243383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:58.243823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:58.371687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:58.379819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:58.381232 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:58.382484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3333552a-e3cc-4e0e-8069-ff43a98e3246 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.152493 Nov 02 20:33:58.383043 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 217/433] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:58 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:58.518801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:58.519206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:58.525954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:58.526427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:58.526852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:58.527528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:58.528005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:58.528420 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:58.551602 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-43d77e7f-821c-4cf7-b201-1528870aa4de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/ips" status: 200 len: 149 microversion: 2.1 time: 0.036586 Nov 02 20:33:58.552173 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 217/434] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:33:58 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:33:58.940100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:58.940708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:58.947275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:58.947801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:58.948238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:58.948930 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:58.949384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:58.949807 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:59.079271 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:59.087893 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-16f5cf94-e9e5-41d9-80c7-b6fd59cb22fd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.151621 Nov 02 20:33:59.088458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 218/435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:33:58 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:33:59.408397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:33:59.409008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:59.415522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:59.416035 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:59.416471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:59.417152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:59.417612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:59.418033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:59.543882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:59.552885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:59.554338 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:33:59.555506 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9582131a-1d7b-4d62-8a58-b1ef51f709dc tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.151148 Nov 02 20:33:59.556101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 218/436] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:33:59 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:33:59.917084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d53f98ca-d999-4a40-a240-3aebf5be1ce2"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:33:59.920011 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:33:59.927767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:59.928251 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:59.928684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:33:59.929379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:33:59.929829 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:33:59.930250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:00.109978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:00.110583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:00.116838 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:00.117344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:00.117768 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:00.118450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:00.118898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:00.119311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:00.198421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-26b3dfe7-7e16-44db-abf4-07d28c0d167b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285399 Nov 02 20:34:00.199036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 219/437] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:33:59 2022] POST /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:34:00.275797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:00.283899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-479495ac-0d4a-4a7f-bcc5-5f19bd306c15 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.177624 Nov 02 20:34:00.284457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 219/438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:00 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:34:00.583781 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:00.584481 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:00.591216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:00.591631 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:00.592077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:00.592772 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:00.593227 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:00.593650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:00.719907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:00.723312 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:00.728373 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:00.729808 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:00.730959 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b056827f-d8d5-4c8a-afbe-926b7a21d6b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.152242 Nov 02 20:34:00.731491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 220/439] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:00 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:01.307853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:01.308463 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:01.314738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:01.315217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:01.315666 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:01.316711 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:01.317197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:01.317610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:01.443645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:01.451682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cc1d57bf-1a35-4cd6-94a4-be83b743be68 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.147709 Nov 02 20:34:01.452283 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 220/440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:01 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:01.757064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:01.757670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:01.765091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:01.765558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:01.765984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:01.766657 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:01.767100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:01.767511 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:01.897826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:01.905722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:01.907135 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:01.908311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-aef28f65-8f9f-4f6d-9f27-cca45f49f07e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1744 microversion: 2.20 time: 0.155950 Nov 02 20:34:01.908860 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 221/441] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:01 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:02.475531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:02.476289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:02.484868 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:02.485735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:02.486521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:02.487795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:02.488647 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:02.488647 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:02.620444 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:02.628598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6056e666-f1d2-4eef-8784-50338b3dcf61 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.157611 Nov 02 20:34:02.629173 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 221/442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:02 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:02.935307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:02.935932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:02.942982 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:02.943452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:02.943915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:02.944591 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:02.945034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:02.945447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:03.072234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:03.080142 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:03.081560 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:03.082696 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f4827100-4421-4eca-89da-fb65f6453c3b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1744 microversion: 2.20 time: 0.151251 Nov 02 20:34:03.083241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 222/443] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:02 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:03.651847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:03.652384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:03.658739 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:03.659219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:03.659677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:03.660868 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:03.661332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:03.661760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:03.789937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:03.798088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-99222b21-8503-4fa6-864a-009d13d50a71 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.150262 Nov 02 20:34:03.798655 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 222/444] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:03 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:04.108381 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:04.108979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:04.116065 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:04.116550 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:04.116988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:04.117680 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:04.118134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:04.118556 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:04.255844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:04.264064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:04.265497 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:04.266650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7afd49d8-d6a5-4333-91f7-8c134bd775b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1744 microversion: 2.20 time: 0.162219 Nov 02 20:34:04.267211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 223/445] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:04 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:04.822160 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:04.822697 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:04.829394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:04.829881 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:04.830310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:04.830994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:04.831443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:04.832410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:04.958207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:04.966443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-323334b6-12db-41d2-8e1a-b0dc98f7ccd7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.148230 Nov 02 20:34:04.967007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 223/446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:04 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:05.291244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:05.291867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:05.298173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:05.298637 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:05.299058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:05.299752 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:05.300197 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:05.301143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:05.429379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:05.437477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:05.438888 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:05.440081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d14997b9-af9b-4db8-9656-80efc1c72b4f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1744 microversion: 2.20 time: 0.152743 Nov 02 20:34:05.440618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 224/447] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:05 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:05.989691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:05.990224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:05.996677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:05.997155 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:05.997578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:05.998256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:05.998707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:05.999123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:06.046562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-fe71eff3-f19e-475c-b952-6991c00dc46e req-2ec85fec-295a-4e5f-98eb-d2f74210d56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6257b48a-e22b-448d-a9be-458c3c9517c9", "name": "network-vif-plugged", "status": "completed", "tag": "0abd5e39-f20b-413e-b780-db9205640fd2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:06.058864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fe71eff3-f19e-475c-b952-6991c00dc46e req-2ec85fec-295a-4e5f-98eb-d2f74210d56d service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:06.059339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fe71eff3-f19e-475c-b952-6991c00dc46e req-2ec85fec-295a-4e5f-98eb-d2f74210d56d service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:06.059801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fe71eff3-f19e-475c-b952-6991c00dc46e req-2ec85fec-295a-4e5f-98eb-d2f74210d56d service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:06.073593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-fe71eff3-f19e-475c-b952-6991c00dc46e req-2ec85fec-295a-4e5f-98eb-d2f74210d56d service nova] Creating event network-vif-plugged:0abd5e39-f20b-413e-b780-db9205640fd2 for instance 6257b48a-e22b-448d-a9be-458c3c9517c9 on hv-cinder-86236 Nov 02 20:34:06.078631 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-fe71eff3-f19e-475c-b952-6991c00dc46e req-2ec85fec-295a-4e5f-98eb-d2f74210d56d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035737 Nov 02 20:34:06.079231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 225/448] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:34:06.136905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:06.145776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fa941277-818f-42a5-baf1-846f4befa3db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.160007 Nov 02 20:34:06.146431 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 224/449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:05 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:06.467281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:06.467997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:06.474877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:06.475355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:06.475934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:06.476619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:06.477068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:06.477486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:06.611119 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:06.620045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:06.621512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:06.622718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9c388fc9-2df2-49d0-997e-c00c8bc8b38c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1744 microversion: 2.20 time: 0.160118 Nov 02 20:34:06.623289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 226/450] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:06 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:07.168370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:07.168980 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:07.175290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:07.175903 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:07.176336 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:07.177053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:07.177507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:07.177929 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:07.304250 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:07.312310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4e122bf9-86b8-46f4-b40e-9e1fce4b0c48 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.147767 Nov 02 20:34:07.312871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 225/451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:07 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:07.648179 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:07.649234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:07.655223 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:07.655818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:07.656208 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:07.656903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:07.657360 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:07.657764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:07.750582 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6c534976-d8fc-450a-889f-3ede3a164fa3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: .version_select at 0x7f2e222a7ee0>, body: {"keypair": {"name": "tempest-keypair-1101769279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPttUaQ5C2GthvwU/Gr/LxNaeUJOxNcLEVIrQj+5vNuU8jMu+ZNAea/FvkiKoVUcRyKm35e+oIzE9/V3j0pwNSaVoHG4t3/aHhSX4XoYbDYr1dr4RdNBFnIR5esmYMcOmA=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:07.767278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-6c534976-d8fc-450a-889f-3ede3a164fa3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:34:07.771286 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-6c534976-d8fc-450a-889f-3ede3a164fa3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:34:07.793791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6c534976-d8fc-450a-889f-3ede3a164fa3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046869 Nov 02 20:34:07.794566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 226/452] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:34:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:34:07.794697 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:07.807874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:07.809333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:07.810529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-158e8d67-6e1c-4cd2-8d44-203ef8577275 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1744 microversion: 2.20 time: 0.166164 Nov 02 20:34:07.811074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 227/453] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:07 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:08.337278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:08.338769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:08.345365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:08.345929 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:08.346425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:08.347181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:08.347874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:08.348492 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:08.369021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:08.572591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:08.590243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dacbd872-983f-4291-a959-a18a225d2270 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.256807 Nov 02 20:34:08.590554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 227/454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:08 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:08.846211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:08.851056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:08.873070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:08.873870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:08.874468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:08.875329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:08.876036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:08.876745 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:09.036256 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:09.049131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:09.054386 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:09.055642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-131b10c4-ed3e-438a-aaa9-1b6de0465cc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.219802 Nov 02 20:34:09.056228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 228/455] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:08 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:09.324293 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-801043703", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb4fd267-779a-4c9f-9357-f71bbe07a717"}], "security_groups": [{"name": "tempest-securitygroup--774836450"}], "key_name": "tempest-keypair-1101769279", "user_data": "}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:09.442895 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] validate_networks() for [('eb4fd267-779a-4c9f-9357-f71bbe07a717', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:34:09.619721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:09.620705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:09.627344 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:09.628137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:09.629244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:09.633458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:09.634248 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:09.635245 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:09.791837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:09.800250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-15dc3059-991f-496a-9080-e73c60e21cd9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1723 microversion: 2.1 time: 0.189664 Nov 02 20:34:09.801762 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 229/456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:09 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:34:09.887317 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:34:09.887788 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:34:09.888259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:34:09.888875 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:34:09.889466 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:34:09.898560 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:09.899047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:09.899488 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:09.900238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:09.900695 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:09.901115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:09.917976 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:34:09.922408 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:34:09.934971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:34:09.937542 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:34:09.984946 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-00d23bc3-e572-4f92-8faf-d6f09855b718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.665141 Nov 02 20:34:09.986249 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 228/457] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:34:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:34:09.997775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7c9bbc07-7875-4a4b-9838-09ba10187684 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:09.998979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7c9bbc07-7875-4a4b-9838-09ba10187684 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:10.071044 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7c9bbc07-7875-4a4b-9838-09ba10187684 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:10.080931 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7c9bbc07-7875-4a4b-9838-09ba10187684 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1241 microversion: 2.1 time: 0.087142 Nov 02 20:34:10.081758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 230/458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:09 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:10.095794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:10.095794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:10.095794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:10.095794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:10.096315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:10.096315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:10.096315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:10.096315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:10.249241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:10.260616 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:10.262396 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:10.264072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ce07c45d-abac-4628-a4e3-6610f36a7aed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.185644 Nov 02 20:34:10.264989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 229/459] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:10 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:34:10.827473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:10.828496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:10.834684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:10.835480 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:10.836144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:10.837053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:10.837697 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:10.838308 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.009868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:11.029028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0383c082-b4d3-4fd2-81dc-278b3ea5231e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1700 microversion: 2.1 time: 0.205306 Nov 02 20:34:11.031677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 231/460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:10 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1700 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:11.056111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d6326c72-efe1-438f-907b-2a42e2e96cce tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:11.064347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d6326c72-efe1-438f-907b-2a42e2e96cce tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:11.065059 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d6326c72-efe1-438f-907b-2a42e2e96cce tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:11.065932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d6326c72-efe1-438f-907b-2a42e2e96cce tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.109378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:11.110691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:11.123738 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:11.124221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:11.124652 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.125353 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:11.125795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:11.126395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.138630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d6326c72-efe1-438f-907b-2a42e2e96cce tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Going to try to start instance {{(pid=118985) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 20:34:11.199463 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d6326c72-efe1-438f-907b-2a42e2e96cce tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action" status: 202 len: 0 microversion: 2.1 time: 0.148961 Nov 02 20:34:11.201062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 230/461] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:34:11 2022] POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:34:11.215326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:11.216070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:11.224842 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:11.225368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:11.226567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.227740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:11.228174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:11.229183 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.245173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:11.255470 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9cdac73b-ebab-4f8f-8a6c-757e097d1e97 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1293 microversion: 2.1 time: 0.150905 Nov 02 20:34:11.257721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 232/462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:11 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:34:11.300271 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:11.301041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:11.310499 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:11.310983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:11.311430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.312140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:11.312623 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:11.313003 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:11.408373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:11.417585 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b8a4df71-b655-498e-850b-a886a2f923cd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1709 microversion: 2.1 time: 0.211527 Nov 02 20:34:11.433368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 231/463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:11 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:11.472438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:11.481679 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:11.483602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:11.485137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-77b70909-24fc-40c6-b5d5-46cc9a22336b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.191586 Nov 02 20:34:11.497778 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 233/464] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:11 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:12.278353 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:12.279078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:12.286478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:12.287294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:12.288032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:12.288966 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:12.289523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:12.290161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:12.359083 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:12.367157 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d23d0cc7-d1bc-47f8-adff-015c0d430cfe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1299 microversion: 2.1 time: 0.092583 Nov 02 20:34:12.369311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 232/465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:12 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:12.444967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:12.447121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:12.455257 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:12.455775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:12.456206 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:12.457999 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:12.458627 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:12.459202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:12.514282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:12.515291 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:12.522472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:12.523254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:12.524258 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:12.525208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:12.526023 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:12.526673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:12.682967 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:12.693638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:12.695705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:12.697234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2222f7f6-3ba4-4670-9435-bc0025562f1d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.186898 Nov 02 20:34:12.713063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 233/466] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:12 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:34:12.884756 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:12.894748 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cfebb7eb-5649-4b2c-abb1-557899bd86c4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1709 microversion: 2.1 time: 0.456362 Nov 02 20:34:12.898061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 234/467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:12 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1709 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:13.392037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:13.393299 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:13.396142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:13.412651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:13.413443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:13.414032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:13.415021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:13.415752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:13.416332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:13.632479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:13.643762 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0ff413a0-1027-4138-98d1-41cf2c5bcdbd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.255394 Nov 02 20:34:13.644418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 234/468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:13 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:13.725684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:13.726388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:13.737482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:13.738526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:13.738945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:13.739688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:13.740314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:13.740900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:13.918268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:13.919279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:13.929062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:13.929928 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:13.930562 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:13.931477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:13.932062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:13.932688 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:13.993905 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:14.006305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:14.007777 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:14.015283 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-44b2043d-241b-4a07-b3bd-ecffd172cbca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.289263 Nov 02 20:34:14.027646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 235/469] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:13 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:14.142241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:14.156056 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-649c7e02-41da-49df-b743-e849e173181a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1713 microversion: 2.1 time: 0.241172 Nov 02 20:34:14.157200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 235/470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:13 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1713 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:14.238993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-99329c5c-7891-47bb-b3e1-cf14c6746cf2 req-85014611-0bc5-4dea-b32c-909f3fe1ccc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe76c605-d9b5-468d-afa3-326f156362bf", "tag": "be1e9899-26ca-48a1-b5fd-87562d7307a2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:14.250184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-99329c5c-7891-47bb-b3e1-cf14c6746cf2 req-85014611-0bc5-4dea-b32c-909f3fe1ccc6 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:14.250574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-99329c5c-7891-47bb-b3e1-cf14c6746cf2 req-85014611-0bc5-4dea-b32c-909f3fe1ccc6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:14.250997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-99329c5c-7891-47bb-b3e1-cf14c6746cf2 req-85014611-0bc5-4dea-b32c-909f3fe1ccc6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:14.272630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-99329c5c-7891-47bb-b3e1-cf14c6746cf2 req-85014611-0bc5-4dea-b32c-909f3fe1ccc6 service nova] Creating event network-changed:be1e9899-26ca-48a1-b5fd-87562d7307a2 for instance fe76c605-d9b5-468d-afa3-326f156362bf on hv-cinder-86236 Nov 02 20:34:14.279234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-99329c5c-7891-47bb-b3e1-cf14c6746cf2 req-85014611-0bc5-4dea-b32c-909f3fe1ccc6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043803 Nov 02 20:34:14.280339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 236/471] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:34:14.667241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:14.668085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:14.675938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:14.676910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:14.677590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:14.678414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:14.678981 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:14.679581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:14.845968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:14.855193 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-26ccc4a6-eb40-45d8-9404-acd7796f9009 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.191727 Nov 02 20:34:14.855799 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 236/472] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:14 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:15.049965 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:15.052609 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:15.060177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:15.060966 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:15.061602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:15.062507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:15.063164 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:15.064032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:15.305520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:15.317297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:15.321096 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:15.322550 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1eb5693d-117d-4958-a85f-b3ec4f1a956b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.280865 Nov 02 20:34:15.325770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 237/473] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:15 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:15.879957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:15.880568 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:15.887125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:15.887632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:15.888071 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:15.888800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:15.889253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:15.889676 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:16.033912 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:16.042358 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ac40a77b-153d-48b5-a6b8-9dc1991b26f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.168189 Nov 02 20:34:16.042958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 237/474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:15 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:34:16.350318 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:16.350967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:16.355996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=59 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:16.362058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:16.362552 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:16.363540 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:16.364433 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:16.364899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:16.365325 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:16.508839 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:16.517373 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:16.518821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:16.520524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-37b38c12-e672-43aa-88bf-829f489c382b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.174810 Nov 02 20:34:16.528132 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 238/475] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:16 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:17.067652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:17.068281 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:17.075273 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:17.076060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:17.076684 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:17.077684 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:17.078131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:17.078609 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:17.232757 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:17.243698 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-84086f2b-fd68-4895-ace6-831169fb33c3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.180978 Nov 02 20:34:17.244287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 238/476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:17 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:17.547383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:17.548230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:17.555015 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:17.555489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:17.555988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:17.556682 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:17.557135 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:17.557580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:17.701715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:17.705418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:17.714120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:17.715529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:17.716724 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-86a61b72-19ca-4515-86dd-bba5c7e8be82 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.174314 Nov 02 20:34:17.727683 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 239/477] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:17 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:18.269623 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:18.270455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:18.276993 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:18.277453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:18.277885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:18.278576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:18.279028 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:18.279446 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:18.416871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:18.424350 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-73ea8275-c3c9-4470-986f-58c41c61888e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.158984 Nov 02 20:34:18.424904 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 239/478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:18 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:18.743413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:18.744046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:18.750317 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:18.750793 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:18.751218 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:18.751915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:18.752362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:18.752771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:18.880172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:18.888067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:18.889568 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:18.890713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c6462a20-366c-4bc6-b730-9b0da035c82d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1739 microversion: 2.20 time: 0.151134 Nov 02 20:34:18.891294 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 240/479] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:18 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:19.446762 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:19.447470 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:19.453780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:19.454264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:19.454699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:19.455392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:19.455873 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:19.456300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:19.587009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:19.594733 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-14ea0637-4397-4094-99c0-6be577786a22 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.151878 Nov 02 20:34:19.595428 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 240/480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:19 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:19.916669 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:19.917306 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:19.923346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:19.923852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:19.924282 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:19.924970 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:19.925489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:19.926001 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:20.075836 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:20.451366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:20.461335 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:20.462781 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:20.464056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-72c847d3-a399-4437-ad68-e4ed2c72179e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1721 microversion: 2.20 time: 0.551171 Nov 02 20:34:20.465066 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 241/481] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:19 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1721 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:34:20.618532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:20.619084 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:20.621032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:20.621687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=10 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:20.628612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:20.629129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:20.629578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:20.630294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:20.630747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:20.631177 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:20.765449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:20.773986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7ba4de5d-a59e-40e7-bc81-f6667a4f6a6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.159411 Nov 02 20:34:20.774944 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 241/482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:20 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:21.491876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:21.492401 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:21.498720 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:21.499195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:21.499640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:21.500339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:21.500795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:21.501214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:21.633494 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:21.641548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:21.642989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:21.644244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c808d778-4d28-49d4-aba8-88a9b17c5ac9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1721 microversion: 2.20 time: 0.157057 Nov 02 20:34:21.644800 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 242/483] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:21 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:21.796812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:21.797367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:21.804377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:21.804854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:21.805278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:21.805959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:21.806429 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:21.806842 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:21.932773 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:21.940329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0026bae5-9377-4e69-a5f5-fca1b03bd174 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.147487 Nov 02 20:34:21.940953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 242/484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:21 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:22.129528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-ca7f3b4a-3514-4881-9fec-42f3269cf3e3 req-b8534ba3-f2ea-482c-ba48-a2d2c796c2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe76c605-d9b5-468d-afa3-326f156362bf", "name": "network-vif-plugged", "status": "completed", "tag": "be1e9899-26ca-48a1-b5fd-87562d7307a2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:22.139451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ca7f3b4a-3514-4881-9fec-42f3269cf3e3 req-b8534ba3-f2ea-482c-ba48-a2d2c796c2d0 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:22.140229 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ca7f3b4a-3514-4881-9fec-42f3269cf3e3 req-b8534ba3-f2ea-482c-ba48-a2d2c796c2d0 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:22.140832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ca7f3b4a-3514-4881-9fec-42f3269cf3e3 req-b8534ba3-f2ea-482c-ba48-a2d2c796c2d0 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:22.152852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-ca7f3b4a-3514-4881-9fec-42f3269cf3e3 req-b8534ba3-f2ea-482c-ba48-a2d2c796c2d0 service nova] Creating event network-vif-plugged:be1e9899-26ca-48a1-b5fd-87562d7307a2 for instance fe76c605-d9b5-468d-afa3-326f156362bf on hv-cinder-86236 Nov 02 20:34:22.157655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-ca7f3b4a-3514-4881-9fec-42f3269cf3e3 req-b8534ba3-f2ea-482c-ba48-a2d2c796c2d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031920 Nov 02 20:34:22.158442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 243/485] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:34:22.670255 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:22.670865 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:22.677813 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:22.678287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:22.678717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:22.679478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:22.679967 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:22.680379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:22.812703 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:22.816986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:22.822797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:22.824257 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:22.825442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c158d5b0-86d0-4e12-9675-c78257c79547 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1724 microversion: 2.20 time: 0.159214 Nov 02 20:34:22.826218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 243/486] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:22 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:22.852688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcee2a18-0e60-4044-a0f6-6a0ce03c2f87"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:22.855071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:22.863744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:22.864323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:22.865241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:22.865938 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:22.866388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:22.867082 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:22.967583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:22.968461 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:22.975914 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:22.976402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:22.976831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:22.977521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:22.977969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:22.978392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:23.118054 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:23.126253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-962a747c-945c-49b9-a088-a4621d721718 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.163096 Nov 02 20:34:23.126828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 244/487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:22 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:34:23.154931 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cc21af96-7402-42c3-b35c-c81841b164ad tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306999 Nov 02 20:34:23.155552 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 244/488] 10.222.0.26 () {62 vars in 1364 bytes} [Wed Nov 2 20:34:22 2022] POST /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 20:34:23.282867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:23.283482 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:23.290057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:23.290536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:23.290968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:23.291686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:23.292141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:23.292561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:23.333816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118985) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 20:34:23.401851 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e3b8577e-0758-43ff-bac2-9a0e44c40f6e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/action" status: 202 len: 0 microversion: 2.20 time: 0.123270 Nov 02 20:34:23.402458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 245/489] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Nov 2 20:34:23 2022] POST /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:34:23.411240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:23.412013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:23.419060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:23.419637 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:23.420168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:23.420882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:23.421339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:23.421765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:23.559309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:23.568264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:23.569689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:23.570837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cded64d5-71b2-4ceb-aa7d-85ad83723e01 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1810 microversion: 2.20 time: 0.164246 Nov 02 20:34:23.571385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 245/490] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:23 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:24.151107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:24.151751 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:24.157904 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:24.158382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:24.158810 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:24.159563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:24.160079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:24.160508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:24.202347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-f7aee4a4-5772-4f22-b5d6-4340310242d7 req-7e4e92b8-6f2f-4afb-9760-72ea3fda4187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6257b48a-e22b-448d-a9be-458c3c9517c9", "name": "network-vif-unplugged", "status": "completed", "tag": "0abd5e39-f20b-413e-b780-db9205640fd2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:24.223235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f7aee4a4-5772-4f22-b5d6-4340310242d7 req-7e4e92b8-6f2f-4afb-9760-72ea3fda4187 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:24.223654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f7aee4a4-5772-4f22-b5d6-4340310242d7 req-7e4e92b8-6f2f-4afb-9760-72ea3fda4187 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:24.224088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f7aee4a4-5772-4f22-b5d6-4340310242d7 req-7e4e92b8-6f2f-4afb-9760-72ea3fda4187 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:24.235461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-f7aee4a4-5772-4f22-b5d6-4340310242d7 req-7e4e92b8-6f2f-4afb-9760-72ea3fda4187 service nova] Creating event network-vif-unplugged:0abd5e39-f20b-413e-b780-db9205640fd2 for instance 6257b48a-e22b-448d-a9be-458c3c9517c9 on hv-cinder-86236 Nov 02 20:34:24.242027 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-f7aee4a4-5772-4f22-b5d6-4340310242d7 req-7e4e92b8-6f2f-4afb-9760-72ea3fda4187 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043276 Nov 02 20:34:24.242619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 246/491] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:34:24.311831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:24.320604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4c8ef3df-7cf3-4c53-99dc-b36c50a57afc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1366 microversion: 2.1 time: 0.174594 Nov 02 20:34:24.321187 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 246/492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:24 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:24.597963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:24.598609 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:24.604785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:24.605256 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:24.605681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:24.606361 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:24.606801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:24.607214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:24.744610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:24.753310 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:24.754745 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:24.755914 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5ed534ff-6fc2-48da-bf31-efdc93fd962a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1810 microversion: 2.20 time: 0.162959 Nov 02 20:34:24.756476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 247/493] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:24 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:25.342148 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:25.342746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:25.349094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:25.349567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:25.349988 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:25.350664 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:25.351110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:25.351523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:25.485342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:25.493690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fc58ec3e-0d2d-4448-a909-548b4d4b116a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1555 microversion: 2.1 time: 0.155315 Nov 02 20:34:25.499271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 247/494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:34:25 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:34:25.515453 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:25.516077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:25.523014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:25.523490 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:25.523953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:25.524632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:25.525204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:25.525600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:25.601102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8645a454-190a-40d6-ac37-9e3197fb215e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089375 Nov 02 20:34:25.601695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 248/495] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:34:25 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:34:25.781943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:25.782549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:25.788992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:25.789712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:25.790150 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:25.790839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:25.791289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:25.791735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:25.919516 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:25.928638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:25.930311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:25.931561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e4c08bf0-8947-4f1e-a5b0-ff1d2a33b388 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1752 microversion: 2.20 time: 0.153606 Nov 02 20:34:25.932192 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 248/496] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:25 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:26.709337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-9bd5c46e-0d57-4faf-8e6e-45b603ecf5bc req-2299bf20-62de-4028-bcf3-cc20f80c276a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe76c605-d9b5-468d-afa3-326f156362bf", "tag": "be1e9899-26ca-48a1-b5fd-87562d7307a2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:26.718526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-9bd5c46e-0d57-4faf-8e6e-45b603ecf5bc req-2299bf20-62de-4028-bcf3-cc20f80c276a service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:26.718994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-9bd5c46e-0d57-4faf-8e6e-45b603ecf5bc req-2299bf20-62de-4028-bcf3-cc20f80c276a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:26.719416 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-9bd5c46e-0d57-4faf-8e6e-45b603ecf5bc req-2299bf20-62de-4028-bcf3-cc20f80c276a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:26.731273 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-9bd5c46e-0d57-4faf-8e6e-45b603ecf5bc req-2299bf20-62de-4028-bcf3-cc20f80c276a service nova] Creating event network-changed:be1e9899-26ca-48a1-b5fd-87562d7307a2 for instance fe76c605-d9b5-468d-afa3-326f156362bf on hv-cinder-86236 Nov 02 20:34:26.736439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-9bd5c46e-0d57-4faf-8e6e-45b603ecf5bc req-2299bf20-62de-4028-bcf3-cc20f80c276a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031183 Nov 02 20:34:26.737021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 249/497] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:34:26.962641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:26.963968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:26.970453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:26.971063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:26.971588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:26.972937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:26.973784 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:26.974290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:27.127863 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:27.138816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:27.140295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:27.141561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3462b5d9-890d-42d9-9ce7-e74af3e7b8d7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.182816 Nov 02 20:34:27.142125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 249/498] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:26 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:28.168859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:28.169584 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:28.175876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:28.176349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:28.176780 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:28.177464 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:28.177915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:28.178336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:28.311524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:28.320968 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:28.322418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:28.323567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-896205e9-8936-4a7f-b2c0-cdffc75db98d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.159555 Nov 02 20:34:28.324299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 250/499] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:28 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:29.349598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:29.350741 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:29.357955 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:29.358434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:29.358859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:29.359585 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:29.360058 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:29.368238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:29.504702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:29.513432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:29.514899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:29.516104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cbe87b79-47e8-431b-bf13-0273f0dd45ea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.170578 Nov 02 20:34:29.516659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 250/500] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:29 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:30.541882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:30.542486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:30.549862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:30.550683 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:30.551187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:30.551992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:30.552599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:30.553099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:30.688751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:30.697903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:30.699495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:30.700747 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-fe189744-36fe-4b24-a494-cd4e98d874e5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.162735 Nov 02 20:34:30.701313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 251/501] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:30 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:31.726943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:31.727718 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:31.734136 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:31.734612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:31.735038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:31.735745 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:31.736197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:31.736615 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:31.873563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:31.882572 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:31.884029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:31.885287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1186d0d9-3135-457e-9a44-6e9a17101985 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.162232 Nov 02 20:34:31.885902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 251/502] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:31 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:32.912120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:32.912802 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:32.919304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:32.919819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:32.920288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:32.920984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:32.921433 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:32.921852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:33.057133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:33.065790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:33.067507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:33.068713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d08ebf78-6ba9-47fb-b0d8-6916c4474e3a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.161313 Nov 02 20:34:33.069279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 252/503] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:32 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:34.094664 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:34.095258 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:34.102195 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:34.102681 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:34.103116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:34.103877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:34.104306 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:34.104731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:34.240038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:34.248786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:34.250520 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:34.251873 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bf3a872d-638c-4869-9d03-4cc0c4d09042 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.161144 Nov 02 20:34:34.252449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 252/504] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:34 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:35.278864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:35.279469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:35.287579 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:35.288040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:35.288480 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:35.289177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:35.289631 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:35.290055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:35.431306 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:35.440943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:35.443226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:35.445216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-137de52a-101d-431e-bead-2a177a29a5b2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.170733 Nov 02 20:34:35.445721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 253/505] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:35 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:36.472722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:36.473435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:36.479828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:36.480311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:36.480738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:36.481423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:36.481871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:36.482288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:36.623658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:36.633062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:36.634495 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:36.635671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3941aab4-283c-4f64-8f3f-e17ab318b51f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.167710 Nov 02 20:34:36.636432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 253/506] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:36 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:37.664193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:37.665084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:37.672030 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:37.672517 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:37.672956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:37.673734 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:37.674115 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:37.674598 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:37.812052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:37.821766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:37.823502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:37.824784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c947eb2f-608b-4c67-892f-964cb303c218 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.164654 Nov 02 20:34:37.825493 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 254/507] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:37 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:38.853441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:38.854029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:38.860434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:38.860916 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:38.861349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:38.862053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:38.862642 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:38.863072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:39.009355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:39.018345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:39.020658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:39.021992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ea94b557-ef93-41b2-aaa4-7bcac521330e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.172604 Nov 02 20:34:39.029280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 254/508] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:38 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:40.049172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:40.049806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:40.056977 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:40.057452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:40.057886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:40.058572 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:40.059026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:40.059448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:40.189887 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:40.199123 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:40.200590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:40.201741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-45afa3a1-a268-420b-bdf4-c371a55a75b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.156532 Nov 02 20:34:40.202297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 255/509] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:40 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:41.227493 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:41.228163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:41.234514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:41.234988 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:41.235412 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:41.236125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:41.236574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:41.236993 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:41.362549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:41.372360 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:41.373801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:41.374968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fe6b11f4-c7f1-4e7b-b428-2a0a3c154192 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.151336 Nov 02 20:34:41.375873 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 255/510] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:41 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:42.402926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:42.403526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:42.409912 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:42.410526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:42.411350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:42.411915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:42.412385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:42.412828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:42.416898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:42.545149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:42.553705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:42.555143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:42.556298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f47fd2a0-b87f-4a74-ab43-2c1befa0d45d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.157326 Nov 02 20:34:42.556848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 256/511] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:42 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:34:43.581771 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:43.582887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:43.585348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:43.591177 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:43.591716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:43.592148 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:43.592837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:43.593288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:43.593715 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:43.727592 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:43.736373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:43.737855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:43.739272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b9aac210-79fa-4233-85f1-87d8d9c5e5ce tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.161450 Nov 02 20:34:43.739866 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 256/512] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:43 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:44.764569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:44.765175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:44.771762 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:44.772240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:44.772672 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:44.773356 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:44.773806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:44.774225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:44.906596 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:44.915718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:44.917143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:44.918296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-08251dcf-1e38-4e48-9728-ba54e6f29a59 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.157645 Nov 02 20:34:44.918852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 257/513] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:44 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:45.944932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:45.945538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:45.951885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:45.952390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:45.952825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:45.953507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:45.954313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:45.954737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:46.080120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:46.088654 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:46.090120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:46.091274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-be8b64c7-91ba-405f-8677-9a766a003c20 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.150966 Nov 02 20:34:46.091863 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 257/514] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:45 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:47.116573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:47.117095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:47.119133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=40 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:47.124319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:47.124803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:47.125243 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:47.125926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:47.126374 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:47.126791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:47.262893 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:47.271634 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:47.273073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:47.274223 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f78bd8d9-c05f-40a1-925a-fd04e63c1040 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.161779 Nov 02 20:34:47.274786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 258/515] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:47 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:48.299866 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:48.300502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:48.307182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:48.307682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:48.308112 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:48.308791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:48.309244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:48.309662 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:48.435297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:48.444809 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:48.446240 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:48.447404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fbfd3cd9-0dfd-4ff2-8ca3-97ee6692dd04 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.151550 Nov 02 20:34:48.447994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 258/516] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:48 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:49.474882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:49.475418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:49.481901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:49.482402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:49.482839 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:49.483529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:49.484009 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:49.484432 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:49.615403 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:49.623994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:49.625412 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:49.626561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cace0e79-7537-450a-b982-7d489ab616b3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.156959 Nov 02 20:34:49.627117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 259/517] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:49 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:50.653269 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:50.653877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:50.661124 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:50.661604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:50.662032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:50.662719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:50.663171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:50.663590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:50.681578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:50.795239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:50.804625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:50.806057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:50.807213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e6fbf5d1-cf18-4b1b-a6f9-540d5a8ffc09 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.157923 Nov 02 20:34:50.807800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 259/518] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:50 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:51.834024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:51.834621 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:51.840952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:51.841422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:51.841846 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:51.842520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:51.842963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:51.843375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:51.977143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:51.985660 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:51.987041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:51.988741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5de06252-91c3-4606-9f7d-1d79ba988d64 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.158109 Nov 02 20:34:51.989584 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 260/519] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:51 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:53.018480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:53.018480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:53.021857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:53.022327 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:53.022748 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:53.023435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:53.023904 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:53.024318 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:53.157265 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:53.166453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:53.167901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:53.169052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8c7256f8-c378-4a9d-8f99-f4dc7ed5376a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.158684 Nov 02 20:34:53.169603 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 260/520] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:53 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:54.195680 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:54.196532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:54.202803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:54.203280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:54.203745 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:54.204431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:54.204875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:54.205290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:54.338641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:54.347306 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:54.348858 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-8a134170-897a-4807-8380-d0d6c8e10a87 req-94b01d44-a003-4e21-a02c-fcedb6b354bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6257b48a-e22b-448d-a9be-458c3c9517c9", "name": "network-vif-plugged", "status": "completed", "tag": "0abd5e39-f20b-413e-b780-db9205640fd2"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:34:54.349395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:54.350759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-97f42ebb-e43a-48ad-8a4b-3f8a58f5d64a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.160333 Nov 02 20:34:54.351311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 261/521] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:54 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:54.359189 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8a134170-897a-4807-8380-d0d6c8e10a87 req-94b01d44-a003-4e21-a02c-fcedb6b354bf service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:54.359847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8a134170-897a-4807-8380-d0d6c8e10a87 req-94b01d44-a003-4e21-a02c-fcedb6b354bf service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:54.360288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8a134170-897a-4807-8380-d0d6c8e10a87 req-94b01d44-a003-4e21-a02c-fcedb6b354bf service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:54.371920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-8a134170-897a-4807-8380-d0d6c8e10a87 req-94b01d44-a003-4e21-a02c-fcedb6b354bf service nova] Creating event network-vif-plugged:0abd5e39-f20b-413e-b780-db9205640fd2 for instance 6257b48a-e22b-448d-a9be-458c3c9517c9 on hv-cinder-86236 Nov 02 20:34:54.376797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-8a134170-897a-4807-8380-d0d6c8e10a87 req-94b01d44-a003-4e21-a02c-fcedb6b354bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032665 Nov 02 20:34:54.377387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 261/522] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:34:55.376803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:55.377346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:55.384238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:55.384711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:55.385141 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:55.385818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:55.386261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:55.386671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:55.517173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:55.525780 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:55.527204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:55.528405 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c261347e-a37a-49d0-b258-5b21288c22e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.155489 Nov 02 20:34:55.528956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 262/523] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:55 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:56.554958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:56.555579 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:56.561601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:56.562070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:56.562495 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:56.563205 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:56.563677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:56.564097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:56.696413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:56.704847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:56.706296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:56.708088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-032c9c59-ef00-41ab-b62e-9c785e462e70 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.157933 Nov 02 20:34:56.708646 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 262/524] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:56 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:57.733498 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:57.734466 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:57.741467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:57.742010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:57.742439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:57.743124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:57.743570 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:57.744023 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:57.875656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:57.884590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:57.886013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:57.887157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-da9b3971-7b84-4b08-bfee-24e66b50b2cf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1808 microversion: 2.20 time: 0.158559 Nov 02 20:34:57.887723 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 263/525] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:57 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:34:58.913370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:34:58.913971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:34:58.920382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:58.920862 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:58.921292 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:58.921974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:34:58.922423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:34:58.922842 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:34:59.052242 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:59.061154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:59.062626 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:34:59.063818 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-96fd29e7-4b21-4c8d-9ce3-d6c4f62eae91 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1795 microversion: 2.20 time: 0.154904 Nov 02 20:34:59.064374 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 263/526] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:34:58 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:35:03.651792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99bbac7e-a98b-43e7-97a1-bad130885942"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:03.654146 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:03.661307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:03.661779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:03.662204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:03.662884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:03.663328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:03.663774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:03.924290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-313c01d9-374e-49de-9cc1-8f956cea5ba8 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276211 Nov 02 20:35:03.924792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 264/527] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:35:03 2022] POST /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:35:11.459129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:11.461294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:11.463555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=15 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:11.464346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=22 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:11.469871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:11.470342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:11.470765 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:11.471442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:11.471913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:11.472918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:11.494982 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lazy-loading 'flavor' on Instance uuid a6199abf-c24b-4e3a-acda-9231911771b6 {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:35:11.712182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f3a40e6d-08b3-49b6-8e5c-f6198da1fce5 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/action" status: 200 len: 32 microversion: 2.1 time: 0.257488 Nov 02 20:35:11.712811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 264/528] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:35:11 2022] POST /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:35:11.724087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:11.724789 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:11.733174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:11.733874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:11.734482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:11.735377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:11.735863 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:11.736289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:11.988616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:11.996698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-883cc769-1d0a-493a-995c-dea327d66db6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.278203 Nov 02 20:35:11.997277 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 265/529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:11 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:13.022098 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:13.022833 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:13.029013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:13.029512 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:13.029924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:13.030612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:13.031067 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:13.031486 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:13.165198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:13.173437 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-45f58174-40b1-4f2c-b41f-c3a3643ad42f tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.156777 Nov 02 20:35:13.174012 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 265/530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:13 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:14.197031 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:14.197636 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:14.203991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:14.204467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:14.204906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:14.205585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:14.206032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:14.207299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:14.211275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:14.335215 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:14.343285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-87e60b11-9827-4538-9aba-e8d7c2b7d8cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.150127 Nov 02 20:35:14.343890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 266/531] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:14 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:15.366740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:15.367345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:15.373682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:15.374163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:15.374633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:15.375308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:15.375780 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:15.376201 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:15.502121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:15.510795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-310e1c16-af34-4474-aed4-be67dd5b6372 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.147789 Nov 02 20:35:15.511411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 266/532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:15 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:16.535245 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:16.535911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:16.542254 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:16.542735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:16.543167 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:16.543886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:16.544341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:16.544764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:16.673238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:16.682187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-216999cc-bd64-43e1-a8cd-bae89f506e60 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.151486 Nov 02 20:35:16.682749 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 267/533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:16 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:17.706865 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:17.707966 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:17.714626 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:17.715098 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:17.715525 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:17.716246 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:17.716696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:17.717113 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:17.842122 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:17.850786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b5084431-14af-4c90-a7a7-b626214e894a tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.148601 Nov 02 20:35:17.851360 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 267/534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:17 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:18.874136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:18.874741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:18.877072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=20 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:18.883309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:18.883825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:18.884261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:18.884949 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:18.885403 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:18.885820 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:19.020162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:19.028242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-aff99122-6811-4414-97c1-64bd47d756c1 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.157979 Nov 02 20:35:19.028779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 268/535] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:18 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:20.052063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:20.052645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:20.059186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:20.059736 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:20.060231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:20.060925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:20.061353 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:20.061765 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:20.191286 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:20.199869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2f34cf02-a0c7-40de-a64e-682e3e21a162 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.151896 Nov 02 20:35:20.200447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 268/536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:20 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:21.223855 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:21.224228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:21.230548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:21.231022 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:21.231449 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:21.232156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:21.232604 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:21.233018 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:21.357356 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:21.366383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-701626e5-f425-433d-93f2-3a36baf1f1e3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.145791 Nov 02 20:35:21.366928 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 269/537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:21 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:22.391038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:22.391666 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:22.398296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:22.398768 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:22.399198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:22.399902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:22.400352 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:22.400776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:22.530164 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:22.539635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c68d2226-8a22-41ad-b2e5-3f7e4466b3de tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.152432 Nov 02 20:35:22.540205 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 269/538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:22 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:22.991131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:22.991686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:22.997539 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:22.998020 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:22.998456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:22.999149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:22.999605 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:23.000057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:23.121516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lazy-loading 'services' on Instance uuid 738d7da5-411f-449b-82cd-ad465b7d559b {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:35:23.236698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-38c17a9e-14b9-409c-a28e-7fab9ed8792f tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-volume_attachments/814ac883-38d0-47a0-9c61-d59bce716bf7" status: 202 len: 0 microversion: 2.1 time: 0.355901 Nov 02 20:35:23.237314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 270/539] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:35:22 2022] DELETE /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-volume_attachments/814ac883-38d0-47a0-9c61-d59bce716bf7 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:35:23.562920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:23.563453 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:23.571074 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:23.571576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:23.572035 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:23.572725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:23.573183 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:23.573605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:23.702526 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:23.713866 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-49e1c981-1dbb-44ab-970a-54835a5a6349 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.154580 Nov 02 20:35:23.714450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 270/540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:23 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:24.739276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:24.740014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:24.746817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:24.747295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:24.747756 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:24.748475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:24.748928 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:24.749350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:24.893164 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:24.901962 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-523fee94-dcc6-478b-9304-6db804e1e9a3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.167450 Nov 02 20:35:24.902562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 271/541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:24 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:25.925984 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:25.926609 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:25.932892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:25.933366 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:25.933790 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:25.934466 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:25.934911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:25.935323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:26.062028 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:26.070938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5ae92ad0-9782-4b5d-b9fa-5d9bf67a281b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1736 microversion: 2.1 time: 0.148820 Nov 02 20:35:26.071499 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 271/542] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:25 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:27.094370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:27.094895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:27.102305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.102781 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.103213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.103926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.104377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.104798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.229256 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:27.237320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-627e056a-754e-42ed-b88b-59318039ad98 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1716 microversion: 2.1 time: 0.146909 Nov 02 20:35:27.237884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 272/543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:27 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:27.346691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:27.347165 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:27.354307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.354779 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.355208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.355918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.356370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.356783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.482076 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] HTTP exception thrown: Cannot 'detach_volume' instance a6199abf-c24b-4e3a-acda-9231911771b6 while it is in vm_state rescued Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Request method failure captured: Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments/99bbac7e-a98b-43e7-97a1-bad130885942 HTTP/1.1 Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNm3Ia54Ecc6_2q4iCCrD28VHkW9NorsS5mgwEf8Y1PPgT1jkebRfgAJN4xzUM_eYdsb2zKz48R7rFcQ6JnNZC6DPQrIaxiP9XnWl_bZCaCHzZ6ORqjwVTfcHqipPR09B21n96vCb3ZgnqAuPtDJK9FuFeLcrBKosvRc1d8dBT7kpw Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:35:27.483659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}] Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 8fd4a5629fff47a69cf26196dbdee674 Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:35:27.485078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Cannot 'detach_volume' instance a6199abf-c24b-4e3a-acda-9231911771b6 while it is in vm_state rescued Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'server_id': 'a6199abf-c24b-4e3a-acda-9231911771b6', 'id': '99bbac7e-a98b-43e7-97a1-bad130885942'} Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6199abf-c24b-4e3a-acda-9231911771b6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:35:27.485747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a6199abf-c24b-4e3a-acda-9231911771b6 while it is in vm_state rescued Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a6199abf-c24b-4e3a-acda-9231911771b6 while it is in vm_state rescued Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:27.489260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Returning 409 to user: Cannot 'detach_volume' instance a6199abf-c24b-4e3a-acda-9231911771b6 while it is in vm_state rescued {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:35:27.490232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-73b7ebd8-6969-48f8-a604-b00d3b40c142 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments/99bbac7e-a98b-43e7-97a1-bad130885942" status: 409 len: 152 microversion: 2.1 time: 0.142606 Nov 02 20:35:27.490232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 272/544] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:35:27 2022] DELETE /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments/99bbac7e-a98b-43e7-97a1-bad130885942 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 20:35:27.494341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:27.494874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:27.500813 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.501294 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.501746 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.502409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.502853 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.503312 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.536025 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-81c50c0b-126d-4d69-8ed0-f80df13c3291 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:27.542585 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81c50c0b-126d-4d69-8ed0-f80df13c3291 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.543055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81c50c0b-126d-4d69-8ed0-f80df13c3291 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.543475 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81c50c0b-126d-4d69-8ed0-f80df13c3291 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.565073 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-81c50c0b-126d-4d69-8ed0-f80df13c3291 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Going to try to stop instance {{(pid=118985) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 20:35:27.575446 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0384c129-8c0e-4c72-8dbf-a7ab511a8263 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "POST /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/action" status: 202 len: 0 microversion: 2.1 time: 0.084798 Nov 02 20:35:27.576326 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 273/545] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:35:27 2022] POST /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:35:27.586426 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:27.587139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:27.597381 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.598081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.598526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.599241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.600216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.601088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.610088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-81c50c0b-126d-4d69-8ed0-f80df13c3291 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action" status: 202 len: 0 microversion: 2.1 time: 0.078421 Nov 02 20:35:27.610679 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 273/546] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:35:27 2022] POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 20:35:27.619387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:27.620103 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:27.626110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.626586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.627008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.628117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:27.628419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:27.628687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:27.766572 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:27.775720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6f615f19-f063-40b0-ba03-765799f30c34 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.160752 Nov 02 20:35:27.776418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 274/547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:27 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:35:27.800743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:27.810149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-10898db5-a9de-4c02-880c-0e38e538b891 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1724 microversion: 2.1 time: 0.228925 Nov 02 20:35:27.810731 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 274/548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:27 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:28.798973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:28.799576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:28.806524 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:28.806991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:28.807420 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:28.808140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:28.808590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:28.809005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:28.834615 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:28.835108 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:28.841386 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:28.841899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:28.842331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:28.843022 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:28.843473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:28.843933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:28.939631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:28.948338 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fba257d6-c470-441a-ab05-5a2b50f67d5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.153134 Nov 02 20:35:28.948938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 275/549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:28 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:28.976045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:28.984163 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ec1c0838-a685-4c23-858e-3dd56d4d88c6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1724 microversion: 2.1 time: 0.153698 Nov 02 20:35:28.984729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 275/550] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:28 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:35:29.972295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:29.972899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:29.980091 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:29.980567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:29.980992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:29.981857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:29.982312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:29.982730 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:30.010304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:30.010866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:30.017375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:30.017840 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:30.018268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:30.018960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:30.019412 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:30.019858 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:30.113563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:30.121560 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8d33d9d2-3b79-4d71-ab37-a4482686081b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.153016 Nov 02 20:35:30.122135 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 276/551] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:29 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:30.156656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:30.165458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e115d1ed-ac93-4f16-b896-532aad8ad8dd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1724 microversion: 2.1 time: 0.159539 Nov 02 20:35:30.166021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 276/552] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:30 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:35:31.144916 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:31.145579 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:31.152028 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:31.152544 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:31.152978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:31.153667 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:31.154120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:31.154543 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:31.172749 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:31.239576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:31.240819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:31.251715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:31.252202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:31.252635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:31.253330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:31.253782 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:31.254201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:31.292085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:31.300160 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-65393aeb-2850-4197-8e8b-b9c20ff7f4f7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.159037 Nov 02 20:35:31.300801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 277/553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:31 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:31.382324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:31.390878 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5fa40dc1-50d8-4571-a2b8-eb9820959e27 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1730 microversion: 2.1 time: 0.205766 Nov 02 20:35:31.391530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 277/554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:31 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:35:31.415920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:31.416376 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:31.422277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:31.422754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:31.423181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:31.423889 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:31.424345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:31.424764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:31.500925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c62fea4f-a3a2-490f-82d3-dce03fec9887 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089606 Nov 02 20:35:31.501549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 278/555] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:35:31 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:35:32.325538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:32.326060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:32.332381 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:32.332898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:32.333333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:32.334139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:32.334597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:32.335025 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:32.469907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:32.478014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-328295bd-89a4-42a6-bfc2-b71fe9e7ebb7 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.156462 Nov 02 20:35:32.478582 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 278/556] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:32 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:32.572325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-8ae7dafa-7cdb-4d60-a8dd-4e2bac4e89b2 req-e8cc4d6b-38f4-4461-b240-b099346dc027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6199abf-c24b-4e3a-acda-9231911771b6", "tag": "78c4d4e5-765c-435d-b699-2638d18df952"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:32.582214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8ae7dafa-7cdb-4d60-a8dd-4e2bac4e89b2 req-e8cc4d6b-38f4-4461-b240-b099346dc027 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:32.582625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8ae7dafa-7cdb-4d60-a8dd-4e2bac4e89b2 req-e8cc4d6b-38f4-4461-b240-b099346dc027 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:32.583047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8ae7dafa-7cdb-4d60-a8dd-4e2bac4e89b2 req-e8cc4d6b-38f4-4461-b240-b099346dc027 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:32.596086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-8ae7dafa-7cdb-4d60-a8dd-4e2bac4e89b2 req-e8cc4d6b-38f4-4461-b240-b099346dc027 service nova] Creating event network-changed:78c4d4e5-765c-435d-b699-2638d18df952 for instance a6199abf-c24b-4e3a-acda-9231911771b6 on hv-cinder-86236 Nov 02 20:35:32.601100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-8ae7dafa-7cdb-4d60-a8dd-4e2bac4e89b2 req-e8cc4d6b-38f4-4461-b240-b099346dc027 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034148 Nov 02 20:35:32.601700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 279/557] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:35:33.501416 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:33.502035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:33.509310 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:33.509794 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:33.510238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:33.510914 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:33.511366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:33.511820 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:33.533180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 20:35:33.533366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Wed Nov 2 20:35:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b (ip 10.222.0.26) !!! Nov 02 20:35:33.648471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:33.656140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8b86bc59-40d8-4b32-81da-254a59015062 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.158592 Nov 02 20:35:33.656714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 279/558] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:33 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:34.617069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-8e5d222a-3e0a-4a66-8665-5659f3a33eab req-2d2236b0-3253-4832-abe7-61c07b4346f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6199abf-c24b-4e3a-acda-9231911771b6", "tag": "78c4d4e5-765c-435d-b699-2638d18df952"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:34.626398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8e5d222a-3e0a-4a66-8665-5659f3a33eab req-2d2236b0-3253-4832-abe7-61c07b4346f6 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:34.626872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8e5d222a-3e0a-4a66-8665-5659f3a33eab req-2d2236b0-3253-4832-abe7-61c07b4346f6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:34.627297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8e5d222a-3e0a-4a66-8665-5659f3a33eab req-2d2236b0-3253-4832-abe7-61c07b4346f6 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:34.638040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-8e5d222a-3e0a-4a66-8665-5659f3a33eab req-2d2236b0-3253-4832-abe7-61c07b4346f6 service nova] Creating event network-changed:78c4d4e5-765c-435d-b699-2638d18df952 for instance a6199abf-c24b-4e3a-acda-9231911771b6 on hv-cinder-86236 Nov 02 20:35:34.642808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-8e5d222a-3e0a-4a66-8665-5659f3a33eab req-2d2236b0-3253-4832-abe7-61c07b4346f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030646 Nov 02 20:35:34.643366 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 280/559] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:35:34.679975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:34.680576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:34.687004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:34.687519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:34.687983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:34.688677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:34.689128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:34.689665 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:34.893932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:34.902607 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9b1e60b2-ee8b-4bc5-8b00-c92facd58bdc tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.226478 Nov 02 20:35:34.903272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 280/560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:34 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:35.926668 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:35.927367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:35.934188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:35.934668 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:35.935108 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:35.935821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:35.936280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:35.936705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:36.067831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:36.075745 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f1b180ed-de0f-4b19-bffa-f5193a2fea7a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.153669 Nov 02 20:35:36.076321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 281/561] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:35 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:37.099549 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:37.100231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:37.106623 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:37.107106 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:37.107538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:37.108247 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:37.108700 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:37.109123 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:37.111714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:37.493457 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:37.501103 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7a09c3c9-24a6-4b60-af0a-59cd9f45b7db tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.405509 Nov 02 20:35:37.501662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 281/562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:37 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:38.524856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:38.525462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:38.532229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:38.532831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:38.533251 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:38.533938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:38.534392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:38.534812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:38.670459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:38.678816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-72195fe8-d443-433f-b600-3410e4224ae1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.159028 Nov 02 20:35:38.679370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 282/563] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:38 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:39.702325 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:39.702986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:39.709472 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:39.709983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:39.710413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:39.711102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:39.711558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:39.712008 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:39.840095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:39.847884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7add5c9f-8043-4fc1-9f27-770e25625a8d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.149446 Nov 02 20:35:39.854412 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 282/564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:39 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:40.871187 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:40.871816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:40.878166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:40.878644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:40.879069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:40.879778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:40.880225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:40.881227 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:41.009708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:41.018714 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-22db2b1d-41c8-47ef-bf2c-c4e97019c6f9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.151376 Nov 02 20:35:41.019278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 283/565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:40 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:42.043451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:42.044047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:42.050499 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:42.050980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:42.051465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:42.052189 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:42.052915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:42.053340 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:42.184787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:42.192718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-efb1244f-73e5-4d0d-b3c8-68670e07774e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1677 microversion: 2.1 time: 0.153267 Nov 02 20:35:42.193398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 283/566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:42 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:43.215933 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:43.216531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:43.219046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=41 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:43.225090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:43.225638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:43.226085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:43.226784 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:43.227243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:43.227699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:43.355509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:43.363105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-52d6271d-401a-437a-8d40-37e69bc08ccd tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1654 microversion: 2.1 time: 0.151096 Nov 02 20:35:43.363686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 284/567] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:43 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:35:43.386174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d1877705-da56-4405-aea5-dba3471b7948 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:43.392484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1877705-da56-4405-aea5-dba3471b7948 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:43.392959 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1877705-da56-4405-aea5-dba3471b7948 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:43.393387 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d1877705-da56-4405-aea5-dba3471b7948 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:43.415423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d1877705-da56-4405-aea5-dba3471b7948 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Going to try to start instance {{(pid=118986) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 20:35:43.456722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d1877705-da56-4405-aea5-dba3471b7948 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action" status: 202 len: 0 microversion: 2.1 time: 0.074378 Nov 02 20:35:43.457302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 284/568] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:35:43 2022] POST /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:35:43.466762 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:43.467378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:43.473340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:43.473818 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:43.475101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:43.475663 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:43.476145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:43.476551 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:43.607332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:43.616289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cc61b045-7d56-447a-ac84-43f9ba899642 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1663 microversion: 2.1 time: 0.153435 Nov 02 20:35:43.625024 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 285/569] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:43 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:44.640519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:44.641234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:44.647878 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:44.648398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:44.648838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:44.649531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:44.649984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:44.650408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:44.788900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:44.796606 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-510f0146-f2c1-46bf-8874-c764f552b789 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1663 microversion: 2.1 time: 0.160938 Nov 02 20:35:44.797179 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 285/570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:44 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:45.821634 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:45.822342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:45.828783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:45.829259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:45.829678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:45.830357 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:45.830803 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:45.831238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:45.961377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:45.969010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dde698ba-e0ea-41fc-a6ae-7270e4f514f4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1667 microversion: 2.1 time: 0.153052 Nov 02 20:35:45.969578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 286/571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:45 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:56.700201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=35 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:56.700978 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:56.752051 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:56.752606 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:56.758976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:56.759448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:56.759907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:56.760590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:56.761037 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:56.761461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:56.784405 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-de9953d2-3032-410a-ae89-47418c55d0c6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf/ips" status: 200 len: 149 microversion: 2.1 time: 0.089081 Nov 02 20:35:56.784949 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 286/572] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:35:56 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf/ips => generated 149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:35:56.796799 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d53f98ca-d999-4a40-a240-3aebf5be1ce2"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:56.799101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:56.802101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=5 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:56.802764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=46 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:56.808646 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:56.809145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:56.809576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:56.810258 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:56.810705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:56.811122 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:56.890017 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Invalid volume: volume d53f98ca-d999-4a40-a240-3aebf5be1ce2 is already attached to instances: a8374bf3-0545-49a4-9acb-3616953c493f Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: POST /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf/os-volume_attachments HTTP/1.1 Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 74 Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:35:56.891752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {"volumeAttachment": {"volumeId": "d53f98ca-d999-4a40-a240-3aebf5be1ce2"}} Nov 02 20:35:56.893411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Invalid volume: volume d53f98ca-d999-4a40-a240-3aebf5be1ce2 is already attached to instances: a8374bf3-0545-49a4-9acb-3616953c493f Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'server_id': 'fe76c605-d9b5-468d-afa3-326f156362bf', 'body': {'volumeAttachment': {'volumeId': 'd53f98ca-d999-4a40-a240-3aebf5be1ce2'}}} Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d53f98ca-d999-4a40-a240-3aebf5be1ce2 is already attached to instances: a8374bf3-0545-49a4-9acb-3616953c493f Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:56.894477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d53f98ca-d999-4a40-a240-3aebf5be1ce2 is already attached to instances: a8374bf3-0545-49a4-9acb-3616953c493f Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:35:56.896536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d53f98ca-d999-4a40-a240-3aebf5be1ce2 is already attached to instances: a8374bf3-0545-49a4-9acb-3616953c493f Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 400 to user: Invalid volume: volume d53f98ca-d999-4a40-a240-3aebf5be1ce2 is already attached to instances: a8374bf3-0545-49a4-9acb-3616953c493f {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a8329318-64e5-425e-807f-a830370a52b7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100477 Nov 02 20:35:56.897983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 287/573] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:35:56 2022] POST /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:35:56.902987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:56.903476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:56.909445 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:56.909921 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:56.910349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:56.911024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:56.911651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:56.912174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:56.936462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:35:57.011911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-41d9a3fc-022c-453c-b266-c5762ac7dd7a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 204 len: 0 microversion: 2.1 time: 0.112239 Nov 02 20:35:57.012840 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 287/574] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:35:56 2022] DELETE /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:35:57.021393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:57.022206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:57.028828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:57.029312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:57.029747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:57.030436 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:57.030893 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:57.031324 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:57.158038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:57.166059 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-423585d6-1c15-46c1-a6fc-134936b3b037 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1680 microversion: 2.1 time: 0.148493 Nov 02 20:35:57.166628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 288/575] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:57 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:58.190102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:58.190791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:58.197425 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:58.197900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:58.198322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:58.198996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:58.199438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:58.199882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:58.329644 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:58.337252 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-845e9010-4c23-4926-8f6d-7bb9f512088e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1680 microversion: 2.1 time: 0.151405 Nov 02 20:35:58.337819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 288/576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:58 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:59.360879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:35:59.361398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:35:59.368465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:59.368947 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:59.369380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:59.370100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:59.370553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:59.370972 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:59.502793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:35:59.512278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-aeabde80-b13c-465d-8027-7871b47dabc1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1680 microversion: 2.1 time: 0.155267 Nov 02 20:35:59.513097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 289/577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:35:59 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:35:59.937120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-94780407-c2c2-42da-a13b-4206fb220a9d req-9c2d9d87-0368-4e8f-97eb-2b0fd11daf13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe76c605-d9b5-468d-afa3-326f156362bf", "name": "network-vif-deleted", "tag": "be1e9899-26ca-48a1-b5fd-87562d7307a2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:35:59.955821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-94780407-c2c2-42da-a13b-4206fb220a9d req-9c2d9d87-0368-4e8f-97eb-2b0fd11daf13 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:35:59.956302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-94780407-c2c2-42da-a13b-4206fb220a9d req-9c2d9d87-0368-4e8f-97eb-2b0fd11daf13 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:35:59.956783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-94780407-c2c2-42da-a13b-4206fb220a9d req-9c2d9d87-0368-4e8f-97eb-2b0fd11daf13 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:35:59.972886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-94780407-c2c2-42da-a13b-4206fb220a9d req-9c2d9d87-0368-4e8f-97eb-2b0fd11daf13 service nova] Creating event network-vif-deleted:be1e9899-26ca-48a1-b5fd-87562d7307a2 for instance fe76c605-d9b5-468d-afa3-326f156362bf on hv-cinder-86236 Nov 02 20:35:59.979052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-94780407-c2c2-42da-a13b-4206fb220a9d req-9c2d9d87-0368-4e8f-97eb-2b0fd11daf13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111969 Nov 02 20:35:59.980301 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 289/578] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:00.535863 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:00.537099 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:00.543567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:00.544084 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:00.544512 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:00.545393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:00.546003 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:00.546791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:00.583702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:00.584706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:00.585319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:00.585957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lazy-loading 'fault' on Instance uuid fe76c605-d9b5-468d-afa3-326f156362bf {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:00.649567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:00.668127 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3b6e410c-d350-46c9-b673-c7a07a6ba5b0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 200 len: 1331 microversion: 2.1 time: 0.136372 Nov 02 20:36:00.680026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 290/579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:00 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 1331 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:01.694242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:01.694903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:01.700900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:01.701371 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:01.701797 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:01.702475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:01.702918 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:01.703332 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:01.716718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf HTTP/1.1 Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:36:01.718287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:36:01.719841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'fe76c605-d9b5-468d-afa3-326f156362bf'} Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:01.720707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:36:01.721987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:01.723062 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:01.723062 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2af78371-4942-4994-bc61-6269864be5bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 404 len: 111 microversion: 2.1 time: 0.030334 Nov 02 20:36:01.723062 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 290/580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:01 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:01.729329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6eb5a493-e988-491e-96d6-eddade8b150b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '.version_select at 0x7f2e220b6280>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:01.749955 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6eb5a493-e988-491e-96d6-eddade8b150b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101769279" status: 202 len: 0 microversion: 2.1 time: 0.024449 Nov 02 20:36:01.750840 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 291/581] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 20:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101769279 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:36:02.407947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:02.408426 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:02.414955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:02.415427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:02.415879 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:02.416561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:02.417004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:02.417418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:02.496549 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lazy-loading 'services' on Instance uuid a8374bf3-0545-49a4-9acb-3616953c493f {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:02.566391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-de81ef75-f029-4db9-a807-3cefb0581b87 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments/d53f98ca-d999-4a40-a240-3aebf5be1ce2" status: 202 len: 0 microversion: 2.1 time: 0.162158 Nov 02 20:36:02.566967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 291/582] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:36:02 2022] DELETE /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments/d53f98ca-d999-4a40-a240-3aebf5be1ce2 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:36:02.576481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:02.579321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:02.586631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:02.586894 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:02.587328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:02.588090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:02.588547 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:02.589159 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:02.620384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-632a41f6-0dc4-490a-b978-ffa4a88a74fe tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048104 Nov 02 20:36:02.620951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 292/583] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:36:02 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:03.633208 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:03.635448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:03.641569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:03.642048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:03.642496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:03.643181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:03.643650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:03.644074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:03.672384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-abcca914-64c7-4691-9237-7197b9d43c76 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044004 Nov 02 20:36:03.672929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 292/584] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:36:03 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 20:36:03.737299 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:03.737827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:03.744495 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:03.744973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:03.745399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:03.746103 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:03.746551 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:03.746964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:03.771735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:36:03.845786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-834f5db5-6cf5-44b9-9a5e-0fa007250772 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 204 len: 0 microversion: 2.1 time: 0.111462 Nov 02 20:36:03.846388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 293/585] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:36:03 2022] DELETE /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:36:03.856029 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:03.856636 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:03.862500 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:03.862978 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:03.863408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:03.864140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:03.864624 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:03.865049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:03.993284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:04.000908 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8d793754-9d1b-4f3e-9eac-abad28cb7e9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1680 microversion: 2.1 time: 0.149703 Nov 02 20:36:04.001474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 293/586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:03 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:05.024983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:05.025594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:05.032120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:05.032600 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:05.033073 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:05.033763 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:05.034253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:05.034674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:05.166196 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:05.173886 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c4eeb18b-6b8f-4def-be58-6c04c054e6ce tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1680 microversion: 2.1 time: 0.153220 Nov 02 20:36:05.174452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 294/587] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:05 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:06.197481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:06.198699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:06.205596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.206321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.206943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.207858 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.208675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.209276 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.276655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:06.277168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:06.283347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.284144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.284582 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.285288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.285739 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.286157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.318285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-68b5f6cf-0497-4f23-986e-d266e7d7feb5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments/fcee2a18-0e60-4044-a0f6-6a0ce03c2f87" status: 200 len: 194 microversion: 2.20 time: 0.148866 Nov 02 20:36:06.319260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 294/588] 10.222.0.26 () {60 vars in 1454 bytes} [Wed Nov 2 20:36:06 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments/fcee2a18-0e60-4044-a0f6-6a0ce03c2f87 => generated 194 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 20:36:06.353099 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:06.361387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-02befa68-02f6-4312-a608-0badd6da0a5d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1680 microversion: 2.1 time: 0.167681 Nov 02 20:36:06.362004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 295/589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:06 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:36:06.402693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:06.403288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:06.410164 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.410647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.411467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.411988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.412672 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.413067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.497407 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lazy-loading 'services' on Instance uuid 6257b48a-e22b-448d-a9be-458c3c9517c9 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:06.574129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-aea50657-f020-46c4-8361-9427c6608908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments/fcee2a18-0e60-4044-a0f6-6a0ce03c2f87" status: 202 len: 0 microversion: 2.20 time: 0.175207 Nov 02 20:36:06.574905 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 295/590] 10.222.0.26 () {60 vars in 1457 bytes} [Wed Nov 2 20:36:06 2022] DELETE /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments/fcee2a18-0e60-4044-a0f6-6a0ce03c2f87 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:36:06.584896 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:06.587559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:06.594082 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.595141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.595597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.596779 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.597232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.597737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.628423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3e25c420-cef2-4d2c-8c99-c3fc8ae40c40 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049097 Nov 02 20:36:06.629876 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 296/591] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Nov 2 20:36:06 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:36:06.698684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-a60247f8-7966-4ffa-828a-1de5f689dc5e req-64a1541a-685b-49df-8952-80ea9fa6b08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8374bf3-0545-49a4-9acb-3616953c493f", "name": "network-vif-deleted", "tag": "8b5041b6-2926-4755-abf3-f108f1b4031d"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:06.716034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a60247f8-7966-4ffa-828a-1de5f689dc5e req-64a1541a-685b-49df-8952-80ea9fa6b08a service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:06.716746 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a60247f8-7966-4ffa-828a-1de5f689dc5e req-64a1541a-685b-49df-8952-80ea9fa6b08a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:06.717207 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a60247f8-7966-4ffa-828a-1de5f689dc5e req-64a1541a-685b-49df-8952-80ea9fa6b08a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:06.744569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-a60247f8-7966-4ffa-828a-1de5f689dc5e req-64a1541a-685b-49df-8952-80ea9fa6b08a service nova] Creating event network-vif-deleted:8b5041b6-2926-4755-abf3-f108f1b4031d for instance a8374bf3-0545-49a4-9acb-3616953c493f on hv-cinder-86236 Nov 02 20:36:06.753465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-a60247f8-7966-4ffa-828a-1de5f689dc5e req-64a1541a-685b-49df-8952-80ea9fa6b08a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059466 Nov 02 20:36:06.754075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 296/592] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:07.385618 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:07.387112 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:07.395153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:07.396075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:07.396812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:07.397755 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:07.398550 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:07.399180 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:07.438154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:07.438626 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:07.439048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:07.439565 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lazy-loading 'fault' on Instance uuid a8374bf3-0545-49a4-9acb-3616953c493f {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:07.486531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:07.495245 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a2069d3d-5f39-405f-a965-b06693f6bc1d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 200 len: 1331 microversion: 2.1 time: 0.114223 Nov 02 20:36:07.495938 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 297/593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:07 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:07.645127 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:07.648279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:07.654689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:07.655172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:07.655605 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:07.656541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:07.657160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:07.657596 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:07.688936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0e6b7a1e-7cf4-4fe7-9b66-8dd17ca1e380 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048660 Nov 02 20:36:07.689507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 297/594] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Nov 2 20:36:07 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:36:08.518505 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:08.519113 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:08.525508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.525985 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.526412 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:08.527090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.527537 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.527977 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:08.541413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f HTTP/1.1 Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:36:08.543029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:36:08.544656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'a8374bf3-0545-49a4-9acb-3616953c493f'} Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:08.545433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:36:08.546610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:08.547660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:08.547660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a8c34fa6-f108-422c-83e1-84354bb18c44 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 404 len: 111 microversion: 2.1 time: 0.030014 Nov 02 20:36:08.547660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 298/595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:08 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:08.554144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-511681bd-2da0-4683-ba4e-bda1d2a17bc8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '.version_select at 0x7f2e220e2310>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:08.579260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-511681bd-2da0-4683-ba4e-bda1d2a17bc8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754150780" status: 202 len: 0 microversion: 2.1 time: 0.029518 Nov 02 20:36:08.579829 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 298/596] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Nov 2 20:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754150780 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:36:08.703633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:08.706093 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:08.713231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.713717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.714237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:08.715118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.715589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.716209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:08.763670 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cbb97dd4-e717-4c9e-a5ed-2709341b0126 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064748 Nov 02 20:36:08.764241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 299/597] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Nov 2 20:36:08 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:08.831040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:08.831641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:08.838416 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.838902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.839337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:08.840079 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.840567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.841005 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:08.867561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:36:08.946343 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-924a8f52-5c80-4a1d-8325-a5ddc272da49 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 204 len: 0 microversion: 2.20 time: 0.119318 Nov 02 20:36:08.947876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 299/598] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 20:36:08 2022] DELETE /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 20:36:08.956156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:08.956970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:08.963456 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.964031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.964527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:08.965347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:08.965968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:08.966559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:09.164806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:09.172945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:09.174457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:09.175704 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ae9a10fd-6190-4eeb-a001-48883abe76a0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.223494 Nov 02 20:36:09.176335 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 300/599] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:08 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:36:09.312293 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5c5222e5-762a-4bcc-b0ca-5782c0794349 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: .version_select at 0x7f2e220e2b80>, body: {"keypair": {"name": "tempest-keypair-682639802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4UKcFfgQ0nqE6ri/re14iAWZfsGJHkZnChKsf7mYnJYDGPHkXmwB6oxIx7X0ol2K0HgoTMjNdn5zd4lHMQcHgC3ceXcFr0vNh6SJe873642uz1Qsih/K4qJH8K2vpZzQ=="}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:09.328427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-5c5222e5-762a-4bcc-b0ca-5782c0794349 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:36:09.332070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-5c5222e5-762a-4bcc-b0ca-5782c0794349 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:36:09.353410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5c5222e5-762a-4bcc-b0ca-5782c0794349 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045423 Nov 02 20:36:09.353996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 300/600] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:36:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:10.203042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:10.203790 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:10.210684 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:10.211379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:10.211940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:10.212704 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:10.213227 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:10.213717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:10.415742 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:10.423778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:10.425214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:10.426367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a83b8609-6548-4d3c-b70b-66d31dcf0b24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.227507 Nov 02 20:36:10.427757 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 301/601] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:10 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:10.733550 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-801656646", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb4fd267-779a-4c9f-9357-f71bbe07a717"}], "security_groups": [{"name": "tempest-securitygroup--256320254"}], "key_name": "tempest-keypair-682639802", "user_data": "}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:10.839892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] validate_networks() for [('eb4fd267-779a-4c9f-9357-f71bbe07a717', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:36:11.353890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:36:11.354305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:36:11.354773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:36:11.355174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:36:11.355656 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:36:11.364866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:11.365346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:11.365774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:11.366492 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:11.366937 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:11.367351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:11.385399 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:36:11.389562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:36:11.401242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:36:11.403703 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:36:11.453160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-de798428-6d3c-438f-b86a-ce6167783f52 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.724217 Nov 02 20:36:11.454025 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 301/602] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:36:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 20:36:11.455202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:11.455922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:11.462935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:11.463849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:11.464434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:11.465297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:11.465418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8f38e6c6-0e76-46bd-8a34-875909ae462e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:11.465999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:11.466119 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8f38e6c6-0e76-46bd-8a34-875909ae462e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:11.466674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:11.534134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8f38e6c6-0e76-46bd-8a34-875909ae462e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:11.544118 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8f38e6c6-0e76-46bd-8a34-875909ae462e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1240 microversion: 2.1 time: 0.082611 Nov 02 20:36:11.560013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 302/603] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:11 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:36:11.643978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:11.647798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:11.655352 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:11.656852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:11.658032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ccc2f2e8-5f88-4c57-b21b-e0be064f7456 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1723 microversion: 2.20 time: 0.207951 Nov 02 20:36:11.658601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 302/604] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:11 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:36:12.102337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-41d3cc1c-6f38-48a3-a016-3b9b2ee5d6d1 req-c9bb04f6-05a9-4b85-9bf7-131e24745750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6257b48a-e22b-448d-a9be-458c3c9517c9", "name": "network-vif-deleted", "tag": "0abd5e39-f20b-413e-b780-db9205640fd2"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:12.113733 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-41d3cc1c-6f38-48a3-a016-3b9b2ee5d6d1 req-c9bb04f6-05a9-4b85-9bf7-131e24745750 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:12.114289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-41d3cc1c-6f38-48a3-a016-3b9b2ee5d6d1 req-c9bb04f6-05a9-4b85-9bf7-131e24745750 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:12.114723 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-41d3cc1c-6f38-48a3-a016-3b9b2ee5d6d1 req-c9bb04f6-05a9-4b85-9bf7-131e24745750 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:12.125540 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-41d3cc1c-6f38-48a3-a016-3b9b2ee5d6d1 req-c9bb04f6-05a9-4b85-9bf7-131e24745750 service nova] Creating event network-vif-deleted:0abd5e39-f20b-413e-b780-db9205640fd2 for instance 6257b48a-e22b-448d-a9be-458c3c9517c9 on hv-cinder-86236 Nov 02 20:36:12.131632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-41d3cc1c-6f38-48a3-a016-3b9b2ee5d6d1 req-c9bb04f6-05a9-4b85-9bf7-131e24745750 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034837 Nov 02 20:36:12.132790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 303/605] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:12.567110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:12.568608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:12.576472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:12.576957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:12.577377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:12.578069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:12.578515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:12.578930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:12.641704 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:12.650090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9eafe0e7-c7b6-4cdf-a0b2-f3b17fc7c6b8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1292 microversion: 2.1 time: 0.086774 Nov 02 20:36:12.650899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 303/606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:12 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:12.684968 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:12.685659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:12.691906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:12.693331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:12.693864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:12.694569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:12.695028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:12.695448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:12.714570 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:12.727853 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:12.728549 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:12.729371 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:12.730134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lazy-loading 'fault' on Instance uuid 6257b48a-e22b-448d-a9be-458c3c9517c9 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:12.776264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:12.784326 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:12.785858 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:12.787076 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0085e504-57c2-407d-b131-308d1ecca430 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 200 len: 1372 microversion: 2.20 time: 0.106367 Nov 02 20:36:12.787669 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 304/607] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:12 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:13.672775 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:13.673539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:13.680187 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:13.680666 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:13.681099 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:13.681783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:13.682229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:13.682643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:13.757636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:13.765882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b5a3139d-9a4c-4819-a074-2b1050f3f930 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1298 microversion: 2.1 time: 0.096927 Nov 02 20:36:13.766781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 304/608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:13 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:13.813889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:13.814523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:13.822155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:13.822663 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:13.823089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:13.823802 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:13.824250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:13.824665 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:13.838094 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] HTTP exception thrown: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Request method failure captured: Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 HTTP/1.1 Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNl_otVLlOzOY1vLJqvMEJapxIFzBBw8mDFvEiyMnQZadyo2jLv3VLRWTBX3EVV96wZlqljSmGdeUE07gcrFVO8HB34O3ouY3LiPbMuB6EmcJwAVjjgIed6LgBN88gxhqOsgiCRb8p4QgZJlQBdvhklXQQUjj6dLhSwEYJJMEMXCYk Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:36:13.839831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}] Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 3a86b6b9d9f54b3680efc6f3b93af3db Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:36:13.841462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '6257b48a-e22b-448d-a9be-458c3c9517c9'} Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:13.842284 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:36:13.843503 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:13.844620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Returning 404 to user: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:13.844620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-68b861df-5275-4c74-aa73-e117b377b90d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 404 len: 111 microversion: 2.20 time: 0.031220 Nov 02 20:36:13.844620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 305/609] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:13 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:36:13.851054 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-31313c75-0491-4396-9c4e-6b6dfe91b316 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '.version_select at 0x7f2e220e9af0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:13.872439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-31313c75-0491-4396-9c4e-6b6dfe91b316 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276025961" status: 204 len: 0 microversion: 2.20 time: 0.025794 Nov 02 20:36:13.873027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 305/610] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Nov 2 20:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276025961 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 20:36:14.547880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c2f8c85e-d332-4df0-9b6e-b414a189693a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'create', calling method: .version_select at 0x7f2e220e24c0>, body: {"keypair": {"name": "tempest-keypair-1626136725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2O+PLDGIgEGyWmiS+awHQceaW9ZZhvpmbMMpyRwT7ILRnRdBkPRKirUvISshb92daCp+w4i1VEkV0LvF2+MbV+CqVmbnbPw4WS4GivKn74plzkjvnujCOAUCjMq2lDSg=="}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:14.566558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-c2f8c85e-d332-4df0-9b6e-b414a189693a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:36:14.571374 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-c2f8c85e-d332-4df0-9b6e-b414a189693a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for user 3a86b6b9d9f54b3680efc6f3b93af3db and project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:36:14.595988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c2f8c85e-d332-4df0-9b6e-b414a189693a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052096 Nov 02 20:36:14.596615 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 306/611] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Nov 2 20:36:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 20:36:14.790389 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:14.791285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:14.798859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:14.799650 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:14.800300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:14.801260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:14.802398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:14.802902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:14.972836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:14.981213 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-95bcbe66-b753-45aa-b500-aa121f35fb98 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.195312 Nov 02 20:36:14.982109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 306/612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:14 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:15.184496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-f4de8f3f-6579-47cc-8a7c-ecae6cb25576 req-5e51418f-5aee-472f-8f86-44299dac308e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df50c4f6-8302-4c6e-8314-d3a70770bd44", "tag": "e0d6d41e-4672-44fe-af9d-07f08384ab60"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:15.201327 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f4de8f3f-6579-47cc-8a7c-ecae6cb25576 req-5e51418f-5aee-472f-8f86-44299dac308e service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:15.201814 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f4de8f3f-6579-47cc-8a7c-ecae6cb25576 req-5e51418f-5aee-472f-8f86-44299dac308e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:15.202460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-f4de8f3f-6579-47cc-8a7c-ecae6cb25576 req-5e51418f-5aee-472f-8f86-44299dac308e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:15.217117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-f4de8f3f-6579-47cc-8a7c-ecae6cb25576 req-5e51418f-5aee-472f-8f86-44299dac308e service nova] Creating event network-changed:e0d6d41e-4672-44fe-af9d-07f08384ab60 for instance df50c4f6-8302-4c6e-8314-d3a70770bd44 on hv-cinder-86236 Nov 02 20:36:15.222694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-f4de8f3f-6579-47cc-8a7c-ecae6cb25576 req-5e51418f-5aee-472f-8f86-44299dac308e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044831 Nov 02 20:36:15.223630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 307/613] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:16.004470 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:16.005673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:16.012310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:16.012862 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:16.013323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:16.014012 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:16.014461 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:16.014879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:16.219382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:16.227907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5fa8ac61-4fd2-42e7-874f-99f3ecac5448 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.227269 Nov 02 20:36:16.228481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 307/614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:15 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:16.251727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1445323773", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7813bd1-69e8-43fc-9008-ebd5992e8c67"}], "security_groups": [{"name": "tempest-securitygroup--1341029892"}], "key_name": "tempest-keypair-1626136725", "user_data": "}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:16.261702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:16.354298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] validate_networks() for [('c7813bd1-69e8-43fc-9008-ebd5992e8c67', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:36:16.718188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:36:16.718649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:36:16.719127 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:36:16.719536 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:36:16.719975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:36:16.730047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:16.730619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:16.730992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:16.731909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:16.732877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:16.732877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:16.749370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:36:16.753382 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Getting quotas for user 3a86b6b9d9f54b3680efc6f3b93af3db and project 2a352130c2b84d68b1408eb2d0472d12. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:36:16.764361 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:36:16.766767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:36:16.813603 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3a660c09-72c8-49bd-9752-3cd97f657db9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.566547 Nov 02 20:36:16.814269 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 308/615] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Nov 2 20:36:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 20:36:16.826558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9c86b0fe-1cd7-42ed-88e6-efcd7f726852 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:16.827163 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9c86b0fe-1cd7-42ed-88e6-efcd7f726852 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:16.881269 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9c86b0fe-1cd7-42ed-88e6-efcd7f726852 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:16.888673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9c86b0fe-1cd7-42ed-88e6-efcd7f726852 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:16.890240 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9c86b0fe-1cd7-42ed-88e6-efcd7f726852 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:16.891460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9c86b0fe-1cd7-42ed-88e6-efcd7f726852 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1282 microversion: 2.20 time: 0.069012 Nov 02 20:36:16.892136 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 308/616] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:16 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:17.250331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:17.250867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:17.258101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:17.258578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:17.259075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:17.259802 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:17.260157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:17.260547 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:17.396438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:17.403962 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cde7dddd-e9a4-4576-871f-3d30b452cbb6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.157573 Nov 02 20:36:17.404530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 309/617] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:17 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:17.917370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:17.917979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:17.924700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:17.925253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:17.925913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:17.927356 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:17.928034 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:17.928643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:17.993229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:18.002950 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:18.004722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:18.006679 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4b91abc9-8d60-43ab-a414-ac2fc6d7feee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1286 microversion: 2.20 time: 0.093397 Nov 02 20:36:18.007796 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 309/618] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:17 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:18.427491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:18.428236 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:18.434617 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:18.435092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:18.435522 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:18.436240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:18.436691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:18.437107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:18.685418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:18.695925 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9c7cc439-045f-45c3-8866-037f63e8d637 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.272275 Nov 02 20:36:18.696507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 310/619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:18 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:19.032692 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:19.033890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:19.041030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:19.041509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:19.041935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:19.042614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:19.043070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:19.043476 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:19.108901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:19.117707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:19.119156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:19.120277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1753cf37-1a82-42d2-a562-848cec5f2b16 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1334 microversion: 2.20 time: 0.091458 Nov 02 20:36:19.120855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 310/620] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:19 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:19.718250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:19.718851 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:19.726342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:19.726733 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:19.727528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:19.728648 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:19.729398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:19.729968 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:19.856911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:19.865333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7f9a67fd-d5be-4ffa-aaaf-4be5d44d606e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.150796 Nov 02 20:36:19.865904 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 311/621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:19 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:20.146455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:20.147086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:20.153625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:20.154110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:20.154541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:20.155243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:20.155722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:20.156175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:20.224256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:20.232426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:20.233849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:20.234968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-41e38161-4035-46db-89bb-016fe56045da tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1340 microversion: 2.20 time: 0.092791 Nov 02 20:36:20.235538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 311/622] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:20 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:20.889141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:20.890801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:20.900838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-d43d1a87-c2b3-446a-9ba3-c433da1a9b61 req-0317828f-7b45-4b3d-b4ec-a3e79e89434f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df50c4f6-8302-4c6e-8314-d3a70770bd44", "name": "network-vif-plugged", "status": "completed", "tag": "e0d6d41e-4672-44fe-af9d-07f08384ab60"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:20.905161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:20.905660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:20.906251 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:20.907675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:20.908135 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:20.908723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:20.911817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d43d1a87-c2b3-446a-9ba3-c433da1a9b61 req-0317828f-7b45-4b3d-b4ec-a3e79e89434f service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:20.912297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d43d1a87-c2b3-446a-9ba3-c433da1a9b61 req-0317828f-7b45-4b3d-b4ec-a3e79e89434f service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:20.912875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d43d1a87-c2b3-446a-9ba3-c433da1a9b61 req-0317828f-7b45-4b3d-b4ec-a3e79e89434f service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:20.925361 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-d43d1a87-c2b3-446a-9ba3-c433da1a9b61 req-0317828f-7b45-4b3d-b4ec-a3e79e89434f service nova] Creating event network-vif-plugged:e0d6d41e-4672-44fe-af9d-07f08384ab60 for instance df50c4f6-8302-4c6e-8314-d3a70770bd44 on hv-cinder-86236 Nov 02 20:36:20.931172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-d43d1a87-c2b3-446a-9ba3-c433da1a9b61 req-0317828f-7b45-4b3d-b4ec-a3e79e89434f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111205 Nov 02 20:36:20.935587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 312/623] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:21.054231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:21.063316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1f1d24a7-abbb-445a-917f-56a9bc8c4c2f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.179686 Nov 02 20:36:21.064477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 312/624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:20 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:21.133564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-b62ebe8c-5bf7-453b-b16b-829fdde2f924 req-36c60dea-07ad-4c6a-b04e-c9095c8f1e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba7c8d9-10eb-437f-a0df-a276b941e16b", "tag": "988104f9-4cc4-40c6-a3d5-9b7b5b41c840"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:21.144099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-b62ebe8c-5bf7-453b-b16b-829fdde2f924 req-36c60dea-07ad-4c6a-b04e-c9095c8f1e2c service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:21.145551 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-b62ebe8c-5bf7-453b-b16b-829fdde2f924 req-36c60dea-07ad-4c6a-b04e-c9095c8f1e2c service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:21.146077 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-b62ebe8c-5bf7-453b-b16b-829fdde2f924 req-36c60dea-07ad-4c6a-b04e-c9095c8f1e2c service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:21.158187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-b62ebe8c-5bf7-453b-b16b-829fdde2f924 req-36c60dea-07ad-4c6a-b04e-c9095c8f1e2c service nova] Creating event network-changed:988104f9-4cc4-40c6-a3d5-9b7b5b41c840 for instance eba7c8d9-10eb-437f-a0df-a276b941e16b on hv-cinder-86236 Nov 02 20:36:21.162920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-b62ebe8c-5bf7-453b-b16b-829fdde2f924 req-36c60dea-07ad-4c6a-b04e-c9095c8f1e2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035443 Nov 02 20:36:21.163511 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 313/625] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:21.261585 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:21.262153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:21.268404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:21.268782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:21.269217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:21.269920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:21.270404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:21.271416 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:21.406939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:21.415876 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:21.417401 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:21.418502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-124768a4-e1cf-450c-a83b-3466165db4f3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1408 microversion: 2.20 time: 0.161555 Nov 02 20:36:21.419060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 313/626] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:21 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:22.089830 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:22.090519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:22.098281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:22.099147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:22.099598 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:22.100321 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:22.100771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:22.101193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:22.228307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:22.235830 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5104978e-8985-47ff-94f2-355a83cbe5b5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.150678 Nov 02 20:36:22.236395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 314/627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:22 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:22.445130 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:22.445764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:22.452155 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:22.452630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:22.453061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:22.453751 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:22.454199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:22.454620 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:22.584200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:22.592061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:22.593494 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:22.594586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-027d8e89-9d4a-4950-8e53-5e4fbd516fdf tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1408 microversion: 2.20 time: 0.154535 Nov 02 20:36:22.595150 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 314/628] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:22 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:23.257386 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:23.257999 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:23.264367 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:23.264840 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:23.265270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:23.265955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:23.266404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:23.266824 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:23.397600 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:23.405174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a2949607-bcf7-46d6-bbb9-bb3278b98144 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.151831 Nov 02 20:36:23.405742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 315/629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:23 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:23.619579 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:23.620206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:23.626721 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:23.627201 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:23.627721 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:23.628415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:23.628871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:23.629289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:23.757404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:23.765426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:23.766856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:23.768011 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-495c0301-cc31-4e3a-9046-5248d62d4fbb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1408 microversion: 2.20 time: 0.152246 Nov 02 20:36:23.768566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 315/630] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:23 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:24.429259 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:24.429883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:24.436254 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:24.436671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:24.437095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:24.437780 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:24.438225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:24.438638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:24.565472 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:24.573281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cd13528c-0878-477c-ac1f-0f5b2f0bedbf tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1365 microversion: 2.1 time: 0.148578 Nov 02 20:36:24.573843 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 316/631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:24 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:24.793408 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:24.794050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:24.800320 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:24.800798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:24.801227 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:24.801917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:24.802475 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:24.802896 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:24.938971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:24.948367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:24.949814 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:24.950913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a86ab77a-ff72-47a4-b3f4-6b216320d096 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1408 microversion: 2.20 time: 0.161481 Nov 02 20:36:24.951657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 316/632] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:24 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:25.595801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:25.596404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:25.602956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:25.603631 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:25.604072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:25.604762 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:25.605209 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:25.605625 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:25.834952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:25.842549 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-38eea7b3-fcf0-4310-a0d4-91b8bacb69f8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1555 microversion: 2.1 time: 0.250611 Nov 02 20:36:25.843116 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 317/633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:25 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:25.864625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:25.865166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:25.871585 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:25.872085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:25.872509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:25.873189 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:25.873634 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:25.874045 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:25.952803 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-aad858a5-23a9-4d3e-82f5-72473450fc3a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092030 Nov 02 20:36:25.953630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 317/634] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:36:25 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:25.977041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:25.977740 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:25.983758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:25.984314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:25.984822 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:25.985590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:25.986103 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:25.986594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:26.121181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:26.131309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:26.132775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:26.133883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4ed31e90-cce7-41a5-91b5-06fe5a3cb963 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1408 microversion: 2.20 time: 0.160838 Nov 02 20:36:26.134456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 318/635] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:25 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:26.867803 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-a07ec613-8e8e-41a7-80d1-ad898478b0ee req-6c2dd119-649d-490c-a592-2482a92dc7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba7c8d9-10eb-437f-a0df-a276b941e16b", "name": "network-vif-plugged", "status": "completed", "tag": "988104f9-4cc4-40c6-a3d5-9b7b5b41c840"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:26.874383 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:26.886986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:26.887745 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=22 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:26.890664 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:26.895530 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a07ec613-8e8e-41a7-80d1-ad898478b0ee req-6c2dd119-649d-490c-a592-2482a92dc7b8 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:26.896129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a07ec613-8e8e-41a7-80d1-ad898478b0ee req-6c2dd119-649d-490c-a592-2482a92dc7b8 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:26.896554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a07ec613-8e8e-41a7-80d1-ad898478b0ee req-6c2dd119-649d-490c-a592-2482a92dc7b8 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:26.922674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-a07ec613-8e8e-41a7-80d1-ad898478b0ee req-6c2dd119-649d-490c-a592-2482a92dc7b8 service nova] Creating event network-vif-plugged:988104f9-4cc4-40c6-a3d5-9b7b5b41c840 for instance eba7c8d9-10eb-437f-a0df-a276b941e16b on hv-cinder-86236 Nov 02 20:36:26.928595 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-a07ec613-8e8e-41a7-80d1-ad898478b0ee req-6c2dd119-649d-490c-a592-2482a92dc7b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065710 Nov 02 20:36:26.929443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 318/636] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:26.961817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-fba856e6-4d91-451b-939d-babd62942911 req-c0f7b674-630c-4222-934b-3a7a5a2ac7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df50c4f6-8302-4c6e-8314-d3a70770bd44", "tag": "e0d6d41e-4672-44fe-af9d-07f08384ab60"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:26.971166 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fba856e6-4d91-451b-939d-babd62942911 req-c0f7b674-630c-4222-934b-3a7a5a2ac7b3 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:26.972049 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fba856e6-4d91-451b-939d-babd62942911 req-c0f7b674-630c-4222-934b-3a7a5a2ac7b3 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:26.972654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-fba856e6-4d91-451b-939d-babd62942911 req-c0f7b674-630c-4222-934b-3a7a5a2ac7b3 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:26.985006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-fba856e6-4d91-451b-939d-babd62942911 req-c0f7b674-630c-4222-934b-3a7a5a2ac7b3 service nova] Creating event network-changed:e0d6d41e-4672-44fe-af9d-07f08384ab60 for instance df50c4f6-8302-4c6e-8314-d3a70770bd44 on hv-cinder-86236 Nov 02 20:36:26.995739 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-fba856e6-4d91-451b-939d-babd62942911 req-c0f7b674-630c-4222-934b-3a7a5a2ac7b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113540 Nov 02 20:36:26.996346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 319/637] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:36:27.161312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:27.162260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:27.168834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:27.169516 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:27.170149 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:27.171179 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:27.172209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:27.172691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:27.319553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:27.329031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:27.330615 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:27.331986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-31175be5-9ba0-499e-9652-1ae50ec6f9c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1408 microversion: 2.20 time: 0.176033 Nov 02 20:36:27.337688 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 319/638] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:27 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:28.359012 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:28.359632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:28.365826 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:28.366298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:28.366725 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:28.367408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:28.367882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:28.368305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:28.844106 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:28.852797 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:28.854233 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:28.855336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e30774ee-71b1-4b8a-94ce-b820f7de72cb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1408 microversion: 2.20 time: 0.501478 Nov 02 20:36:28.855922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 320/639] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:28 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:29.881876 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:29.882478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:29.889056 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:29.889539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:29.889962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:29.890648 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:29.891101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:29.891515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:30.020742 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:30.028675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:30.030094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:30.031233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5fd32958-67ab-4863-b04b-5d7e0d518521 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1601 microversion: 2.20 time: 0.153737 Nov 02 20:36:30.031835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 320/640] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:36:29 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:36:30.055945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:30.056423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:30.062758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:30.063229 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:30.063681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:30.064360 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:30.064806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:30.065220 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:30.141486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1ad804f7-4283-464f-85c5-10a5122b88b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089978 Nov 02 20:36:30.142109 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 321/641] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Nov 2 20:36:30 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:36:30.555968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:30.556462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:30.562501 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:30.562981 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:30.563413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:30.564219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:30.564673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:30.565096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:30.651005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lazy-loading 'services' on Instance uuid a6199abf-c24b-4e3a-acda-9231911771b6 {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:30.759544 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:30.771296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4c752412-f617-497c-8ec2-5caf4ad3ced0 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments/99bbac7e-a98b-43e7-97a1-bad130885942" status: 202 len: 0 microversion: 2.1 time: 0.219668 Nov 02 20:36:30.771854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 321/642] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:36:30 2022] DELETE /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments/99bbac7e-a98b-43e7-97a1-bad130885942 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:36:30.780268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:30.782849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:30.789110 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:30.789633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:30.790032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:30.790768 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:30.791222 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:30.791669 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:30.825584 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-caf02e43-2c63-4ba3-b672-ca07b0ea8380 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048884 Nov 02 20:36:30.826213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 322/643] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:36:30 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:31.070523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-3d32afde-4620-47cf-a4bf-86f276c1da5d req-f24853e4-3ff4-4014-aa51-33757d0b7882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba7c8d9-10eb-437f-a0df-a276b941e16b", "tag": "988104f9-4cc4-40c6-a3d5-9b7b5b41c840"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:31.080465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-3d32afde-4620-47cf-a4bf-86f276c1da5d req-f24853e4-3ff4-4014-aa51-33757d0b7882 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:31.081027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-3d32afde-4620-47cf-a4bf-86f276c1da5d req-f24853e4-3ff4-4014-aa51-33757d0b7882 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:31.081462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-3d32afde-4620-47cf-a4bf-86f276c1da5d req-f24853e4-3ff4-4014-aa51-33757d0b7882 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:31.093073 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-3d32afde-4620-47cf-a4bf-86f276c1da5d req-f24853e4-3ff4-4014-aa51-33757d0b7882 service nova] Creating event network-changed:988104f9-4cc4-40c6-a3d5-9b7b5b41c840 for instance eba7c8d9-10eb-437f-a0df-a276b941e16b on hv-cinder-86236 Nov 02 20:36:31.098005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-3d32afde-4620-47cf-a4bf-86f276c1da5d req-f24853e4-3ff4-4014-aa51-33757d0b7882 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033006 Nov 02 20:36:31.099896 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 322/644] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:31.839944 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:31.842307 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:31.850278 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:31.850994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:31.851598 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:31.852650 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:31.853365 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:31.854081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:31.889535 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a694b00f-9290-47ee-9da4-0699c87df66e tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053849 Nov 02 20:36:31.895674 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 323/645] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:36:31 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:36:31.976848 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:31.977431 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:31.983976 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:31.984463 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:31.984895 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:31.985598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:31.986060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:31.986472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:32.014140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:36:32.093782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-eccefafc-45ba-48fd-9c85-44d6f17960f3 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 204 len: 0 microversion: 2.1 time: 0.120918 Nov 02 20:36:32.094663 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 323/646] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:36:31 2022] DELETE /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:36:32.102597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:32.103323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:32.109958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:32.110517 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:32.111022 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:32.111821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:32.112366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:32.112969 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:32.252722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:32.261065 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9ed47e6d-35f9-42f3-b312-376c50676f79 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1690 microversion: 2.1 time: 0.162331 Nov 02 20:36:32.261634 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 324/647] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:32 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:33.285375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:33.286968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:33.293104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:33.293588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:33.294020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:33.294709 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:33.295166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:33.295586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:33.423104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:33.430907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d4ca5b7e-8752-494e-a64d-cdab1c775a8b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1690 microversion: 2.1 time: 0.150165 Nov 02 20:36:33.431476 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 324/648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:33 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:34.454359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:34.454867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:34.461961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:34.462438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:34.462901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:34.463581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:34.464097 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:34.464516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:34.593608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:34.602396 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7259b7fd-e985-44d4-adf4-d8ebaeddf67d tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1690 microversion: 2.1 time: 0.152018 Nov 02 20:36:34.602983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 325/649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:34 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:35.625924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:35.626460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:35.632945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:35.633426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:35.633857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:35.634536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:35.634989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:35.635442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:35.770519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:35.778274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-24c92806-db9c-4f44-a0a4-0db12d407830 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1690 microversion: 2.1 time: 0.156229 Nov 02 20:36:35.778848 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 325/650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:35 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:36.802115 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:36.802715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:36.809416 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:36.809889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:36.810319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:36.811007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:36.811452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:36.811899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:36.816070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:36.908262 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:36.915866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7cb7ea85-1c7d-408f-8a45-27f161cb5156 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 200 len: 1623 microversion: 2.1 time: 0.118193 Nov 02 20:36:36.916477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 326/651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:36 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 1623 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:37.027005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-246c0b52-4ce8-49e9-bfe6-cf06751d56d6 req-cd8dd1b4-f5c4-4449-bb33-8ca2c52f2e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6199abf-c24b-4e3a-acda-9231911771b6", "name": "network-vif-deleted", "tag": "78c4d4e5-765c-435d-b699-2638d18df952"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:37.038731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-246c0b52-4ce8-49e9-bfe6-cf06751d56d6 req-cd8dd1b4-f5c4-4449-bb33-8ca2c52f2e28 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:37.039208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-246c0b52-4ce8-49e9-bfe6-cf06751d56d6 req-cd8dd1b4-f5c4-4449-bb33-8ca2c52f2e28 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:37.039652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-246c0b52-4ce8-49e9-bfe6-cf06751d56d6 req-cd8dd1b4-f5c4-4449-bb33-8ca2c52f2e28 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:37.055368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-246c0b52-4ce8-49e9-bfe6-cf06751d56d6 req-cd8dd1b4-f5c4-4449-bb33-8ca2c52f2e28 service nova] Creating event network-vif-deleted:78c4d4e5-765c-435d-b699-2638d18df952 for instance a6199abf-c24b-4e3a-acda-9231911771b6 on hv-cinder-86236 Nov 02 20:36:37.061719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-246c0b52-4ce8-49e9-bfe6-cf06751d56d6 req-cd8dd1b4-f5c4-4449-bb33-8ca2c52f2e28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 Nov 02 20:36:37.062347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 326/652] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:37.939499 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:37.940132 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: a6199abf-c24b-4e3a-acda-9231911771b6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:37.946863 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:37.947337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:37.947817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:37.948506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:37.949172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:37.949595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:37.964630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] HTTP exception thrown: Instance a6199abf-c24b-4e3a-acda-9231911771b6 could not be found. Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Request method failure captured: Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 HTTP/1.1 Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNm3Ia54Ecc6_2q4iCCrD28VHkW9NorsS5mgwEf8Y1PPgT1jkebRfgAJN4xzUM_eYdsb2zKz48R7rFcQ6JnNZC6DPQrIaxiP9XnWl_bZCaCHzZ6ORqjwVTfcHqipPR09B21n96vCb3ZgnqAuPtDJK9FuFeLcrBKosvRc1d8dBT7kpw Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:36:37.966261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}] Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 8fd4a5629fff47a69cf26196dbdee674 Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance a6199abf-c24b-4e3a-acda-9231911771b6 could not be found. Nov 02 20:36:37.967861 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'a6199abf-c24b-4e3a-acda-9231911771b6'} Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6199abf-c24b-4e3a-acda-9231911771b6 could not be found. Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:37.968702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6199abf-c24b-4e3a-acda-9231911771b6 could not be found. Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6199abf-c24b-4e3a-acda-9231911771b6 could not be found. Nov 02 20:36:37.970200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:37.971581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Returning 404 to user: Instance a6199abf-c24b-4e3a-acda-9231911771b6 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:37.971581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-123bdd31-4096-48ad-ae19-5999f4f761e6 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6" status: 404 len: 111 microversion: 2.1 time: 0.032055 Nov 02 20:36:37.971581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 327/653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:37 2022] GET /compute/v2.1/servers/a6199abf-c24b-4e3a-acda-9231911771b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:37.978219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b0d2ea26-5019-4fa6-a354-119583f687cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '.version_select at 0x7f2e220e9b80>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:37.998444 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b0d2ea26-5019-4fa6-a354-119583f687cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139070807" status: 202 len: 0 microversion: 2.1 time: 0.025167 Nov 02 20:36:37.999119 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 327/654] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 20:36:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139070807 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:36:40.855597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:40.856100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:40.862406 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:40.862884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:40.863316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:40.864042 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:40.864493 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:40.864911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:40.889611 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:36:40.964999 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-13655e67-2ee0-4cc5-afdd-44ea39a2a585 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 204 len: 0 microversion: 2.1 time: 0.113635 Nov 02 20:36:40.965580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 328/655] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:36:40 2022] DELETE /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:36:40.974927 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:40.976171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:40.982337 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:40.982870 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:40.983244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:40.983961 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:40.984417 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:40.984839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:41.116201 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:41.125031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f6f585ef-fb88-4766-8634-8798ea94233b tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1509 microversion: 2.1 time: 0.154407 Nov 02 20:36:41.125596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 328/656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:40 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:42.149533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:42.150263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:42.156602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.157072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.157497 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:42.158174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.158637 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.159038 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:42.291519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:42.299108 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2ccb2ac4-8f29-418d-a1fe-29863ec6b1e9 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1509 microversion: 2.1 time: 0.154329 Nov 02 20:36:42.299694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 329/657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:42 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:42.649288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:42.651428 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:42.657896 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.658372 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.658824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:42.659503 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.660004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.660422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:42.688834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9ff32a16-8525-4aa1-a8e1-fa168416a20d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043489 Nov 02 20:36:42.689434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 329/658] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:36:42 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:36:42.752942 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:42.753441 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:42.760078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.760562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.761000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:42.761696 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.762153 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.762580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:42.787268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:36:42.860939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d09932e1-3b21-4645-9e37-c3875c66c500 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 204 len: 0 microversion: 2.1 time: 0.111415 Nov 02 20:36:42.861430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 330/659] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:36:42 2022] DELETE /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:36:42.869957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:42.870588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:42.876425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.876899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.877326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:42.878007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:42.878452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:42.878866 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:43.005214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:43.013502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-db45db0a-de8f-4206-996c-13ef699ac115 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1673 microversion: 2.1 time: 0.147248 Nov 02 20:36:43.014053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 330/660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:42 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:43.322883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:43.323571 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:43.329796 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:43.330272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:43.330699 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:43.331378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:43.331854 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:43.332274 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:43.459283 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:43.467222 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3a63158f-80d4-4ab4-a4f1-1214b28605cd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1509 microversion: 2.1 time: 0.148511 Nov 02 20:36:43.467876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 331/661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:43 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:44.037329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:44.037940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:44.045025 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:44.045509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:44.045941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:44.046638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:44.047090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:44.047514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:44.184995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:44.199919 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8dafa54f-be50-4053-a1ac-86b6814bc4a8 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1673 microversion: 2.1 time: 0.166313 Nov 02 20:36:44.203467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 331/662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:44 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:44.266191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-2c776d6e-23ea-4e51-a23a-03f933dc604d req-75faed19-a57e-4377-a055-17f4bdd8e686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9283ec9e-c3c6-4e56-a927-21452503230f", "name": "network-vif-deleted", "tag": "372a875a-1d32-4fab-896d-2a33843a0aae"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:44.277404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2c776d6e-23ea-4e51-a23a-03f933dc604d req-75faed19-a57e-4377-a055-17f4bdd8e686 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:44.277806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2c776d6e-23ea-4e51-a23a-03f933dc604d req-75faed19-a57e-4377-a055-17f4bdd8e686 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:44.278224 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-2c776d6e-23ea-4e51-a23a-03f933dc604d req-75faed19-a57e-4377-a055-17f4bdd8e686 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:44.290842 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-2c776d6e-23ea-4e51-a23a-03f933dc604d req-75faed19-a57e-4377-a055-17f4bdd8e686 service nova] Creating event network-vif-deleted:372a875a-1d32-4fab-896d-2a33843a0aae for instance 9283ec9e-c3c6-4e56-a927-21452503230f on hv-cinder-86236 Nov 02 20:36:44.295788 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-2c776d6e-23ea-4e51-a23a-03f933dc604d req-75faed19-a57e-4377-a055-17f4bdd8e686 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033307 Nov 02 20:36:44.296790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 332/663] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:44.490224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:44.490834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:44.496978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:44.497535 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:44.497978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:44.498651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:44.499098 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:44.499512 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:44.574791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:44.584291 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4189ec77-b268-47a1-9a0f-6662e6105b1c tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 200 len: 1293 microversion: 2.1 time: 0.098197 Nov 02 20:36:44.587380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 332/664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:44 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:45.230256 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:45.230692 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:45.238235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.238720 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.239146 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.239866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.240452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.240873 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.315465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:45.324238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f7512a7e-ce55-465e-98b5-92be9feb204b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1605 microversion: 2.1 time: 0.101245 Nov 02 20:36:45.324764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 333/665] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:45 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:45.610797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:45.612151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 9283ec9e-c3c6-4e56-a927-21452503230f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:45.619892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.620455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.621260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.622041 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.622573 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.623075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.638220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] HTTP exception thrown: Instance 9283ec9e-c3c6-4e56-a927-21452503230f could not be found. Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Request method failure captured: Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f HTTP/1.1 Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNm3Ia54Ecc6_2q4iCCrD28VHkW9NorsS5mgwEf8Y1PPgT1jkebRfgAJN4xzUM_eYdsb2zKz48R7rFcQ6JnNZC6DPQrIaxiP9XnWl_bZCaCHzZ6ORqjwVTfcHqipPR09B21n96vCb3ZgnqAuPtDJK9FuFeLcrBKosvRc1d8dBT7kpw Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:36:45.639905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}] Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 8fd4a5629fff47a69cf26196dbdee674 Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 9283ec9e-c3c6-4e56-a927-21452503230f could not be found. Nov 02 20:36:45.641639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '9283ec9e-c3c6-4e56-a927-21452503230f'} Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9283ec9e-c3c6-4e56-a927-21452503230f could not be found. Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:45.645489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9283ec9e-c3c6-4e56-a927-21452503230f could not be found. Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9283ec9e-c3c6-4e56-a927-21452503230f could not be found. Nov 02 20:36:45.647080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:45.648610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Returning 404 to user: Instance 9283ec9e-c3c6-4e56-a927-21452503230f could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:45.648610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c2a8b967-1f11-4cbd-a6ae-53b69dcf5c81 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f" status: 404 len: 111 microversion: 2.1 time: 0.035381 Nov 02 20:36:45.648610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 333/666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:45 2022] GET /compute/v2.1/servers/9283ec9e-c3c6-4e56-a927-21452503230f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:45.651017 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:45.651496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:45.658127 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.658621 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.659055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.659805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.660255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.660670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.690533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:36:45.774303 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e3dfd465-3e6e-4a12-a4cf-7c2f465cb9c4 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "DELETE /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 204 len: 0 microversion: 2.1 time: 0.127896 Nov 02 20:36:45.774900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 334/667] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:36:45 2022] DELETE /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 20:36:45.782890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:45.783532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:45.790951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.791442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.791906 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.792605 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:45.793062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:45.793486 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:45.926828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:45.934725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b989e45c-5b97-4b07-8edc-4e2557cb25bc tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.155737 Nov 02 20:36:45.935291 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 334/668] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:45 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:46.311538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-6c311430-67a3-4594-a96e-5eaf87d74708 req-e94e96e6-7b98-42d3-8065-c347d187f8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738d7da5-411f-449b-82cd-ad465b7d559b", "name": "network-vif-deleted", "tag": "1c24d96e-aa0a-461b-a216-ded8e5906519"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:46.317633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:46.324701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-6c311430-67a3-4594-a96e-5eaf87d74708 req-e94e96e6-7b98-42d3-8065-c347d187f8f2 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:46.325171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-6c311430-67a3-4594-a96e-5eaf87d74708 req-e94e96e6-7b98-42d3-8065-c347d187f8f2 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:46.325590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-6c311430-67a3-4594-a96e-5eaf87d74708 req-e94e96e6-7b98-42d3-8065-c347d187f8f2 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:46.340136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-6c311430-67a3-4594-a96e-5eaf87d74708 req-e94e96e6-7b98-42d3-8065-c347d187f8f2 service nova] Creating event network-vif-deleted:1c24d96e-aa0a-461b-a216-ded8e5906519 for instance 738d7da5-411f-449b-82cd-ad465b7d559b on hv-cinder-86236 Nov 02 20:36:46.345182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-6c311430-67a3-4594-a96e-5eaf87d74708 req-e94e96e6-7b98-42d3-8065-c347d187f8f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037805 Nov 02 20:36:46.345936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 335/669] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:46.348993 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:46.349785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:46.356042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:46.356524 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:46.356948 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:46.357633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:46.358079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:46.358494 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:46.391010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:46.391494 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:46.391985 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:46.392411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lazy-loading 'fault' on Instance uuid 738d7da5-411f-449b-82cd-ad465b7d559b {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:46.434732 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:46.442359 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c2539836-a62a-4878-a546-463b0d4e2714 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1326 microversion: 2.1 time: 0.097318 Nov 02 20:36:46.443178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 335/670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:46 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:36:46.958890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:46.959696 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:46.966449 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:46.966929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:46.967363 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:46.968122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:46.968527 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:46.969531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:47.095901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:47.103479 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a1d30df1-eab8-42d8-8578-a99f255cc8ee tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.149402 Nov 02 20:36:47.104075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 336/671] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:46 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:47.465661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:47.466432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:47.473040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:47.473517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:47.473951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:47.474639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:47.475088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:47.475507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:47.509707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:47.510184 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:47.510618 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:47.511057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lazy-loading 'fault' on Instance uuid 738d7da5-411f-449b-82cd-ad465b7d559b {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:36:47.550898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:47.559923 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-06d61bc9-8b24-4448-b28c-c3232c5dec1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 200 len: 1326 microversion: 2.1 time: 0.098072 Nov 02 20:36:47.560488 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 336/672] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:47 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:48.126362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:48.126909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:48.133238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:48.133707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:48.134128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:48.134804 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:48.135251 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:48.135685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:48.261974 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:48.269680 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-44ef8238-ee8d-4819-8bc5-c530eb0c5d67 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1521 microversion: 2.1 time: 0.147151 Nov 02 20:36:48.270242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 337/673] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:48 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:48.582459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:48.583074 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:48.591338 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:48.591861 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:48.592296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:48.593002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:48.593455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:48.593876 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:48.608764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] HTTP exception thrown: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Request method failure captured: Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b HTTP/1.1 Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNZOW8dHijMrFb9vJuL7qTPmbei_EdCxIwqNF8kX9aZ3BOsJfnwBF6cZrYY_9WdnRPnK8TIfbSBMHnTqS97WcaZRgI0lL8PKyJIbYT50bDmYsxxl4qBlvQ5cD2bXN4eVoGC35lJSG2uZx8Ac-AkKV6qEhBx_Z7AALTuJdPdrnIsYEA Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:36:48.610304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}] Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: aa1a7490162d4aeaa1f96da542fea26f Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:36:48.611743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '738d7da5-411f-449b-82cd-ad465b7d559b'} Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:48.612513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:36:48.613872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:48.614872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Returning 404 to user: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:48.614872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b72a554b-44ff-4fbe-9bd4-450a8ff5cd3e tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 404 len: 111 microversion: 2.1 time: 0.033240 Nov 02 20:36:48.614872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 337/674] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:48 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:48.621556 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7bb4e24c-93df-453e-a53d-8d79280cb980 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '.version_select at 0x7f2e220e25e0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:48.641428 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7bb4e24c-93df-453e-a53d-8d79280cb980 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994649002" status: 202 len: 0 microversion: 2.1 time: 0.024145 Nov 02 20:36:48.642348 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 338/675] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Nov 2 20:36:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994649002 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:36:49.288208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-12922d09-a480-4ef3-bfae-bc9e9b6be0da req-16bfe14e-12c7-487e-9c6b-2db7da6dc4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80aa0a2a-951c-4113-b7df-d2d32b966e13", "name": "network-vif-deleted", "tag": "4b802a9e-a37f-4aa5-82ec-1e14deba17d6"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:49.293788 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:49.295323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:49.303753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:49.304126 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-12922d09-a480-4ef3-bfae-bc9e9b6be0da req-16bfe14e-12c7-487e-9c6b-2db7da6dc4c3 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:49.305243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-12922d09-a480-4ef3-bfae-bc9e9b6be0da req-16bfe14e-12c7-487e-9c6b-2db7da6dc4c3 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:49.305674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-12922d09-a480-4ef3-bfae-bc9e9b6be0da req-16bfe14e-12c7-487e-9c6b-2db7da6dc4c3 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:49.305993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:49.306657 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:49.307825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:49.308502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:49.309300 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:49.317970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-12922d09-a480-4ef3-bfae-bc9e9b6be0da req-16bfe14e-12c7-487e-9c6b-2db7da6dc4c3 service nova] Creating event network-vif-deleted:4b802a9e-a37f-4aa5-82ec-1e14deba17d6 for instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 on hv-cinder-86236 Nov 02 20:36:49.326048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-12922d09-a480-4ef3-bfae-bc9e9b6be0da req-16bfe14e-12c7-487e-9c6b-2db7da6dc4c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041808 Nov 02 20:36:49.326633 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 338/676] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:49.385074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd4a5629fff47a69cf26196dbdee674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75c5cf78474dfcb3c56cdaa26e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:49.392960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a42ad2d4-bde7-4474-9317-035ab8c67ffd tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 200 len: 1306 microversion: 2.1 time: 0.103183 Nov 02 20:36:49.393649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 339/677] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:49 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:49.503750 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fbb737e9-abec-4e2c-beae-8af045efabb9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'create', calling method: .version_select at 0x7f2e220a5ee0>, body: {"keypair": {"name": "tempest-keypair-1718274253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH1Cu7pS3d80cCRUW8XJJQf9U0Q6Gp1J//+piO/LgC4MlrKusp0arHh/jPoV5j05ekJ2HCcKDQhJqZ3L/brbe8Au1/mmoUdG6A5LhTEMyFwWo7SFNwpfGqd1FvZH6EB8Q=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:49.519089 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-fbb737e9-abec-4e2c-beae-8af045efabb9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:36:49.522946 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-fbb737e9-abec-4e2c-beae-8af045efabb9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for user aa1a7490162d4aeaa1f96da542fea26f and project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:36:49.546489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fbb737e9-abec-4e2c-beae-8af045efabb9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047893 Nov 02 20:36:49.547235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 339/678] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:36:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:50.416719 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:50.417342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] [instance: 80aa0a2a-951c-4113-b7df-d2d32b966e13] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:50.423540 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:50.424055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:50.424484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:50.425175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:50.425658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:50.426068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:50.440309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] HTTP exception thrown: Instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 could not be found. Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Request method failure captured: Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 HTTP/1.1 Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNm3Ia54Ecc6_2q4iCCrD28VHkW9NorsS5mgwEf8Y1PPgT1jkebRfgAJN4xzUM_eYdsb2zKz48R7rFcQ6JnNZC6DPQrIaxiP9XnWl_bZCaCHzZ6ORqjwVTfcHqipPR09B21n96vCb3ZgnqAuPtDJK9FuFeLcrBKosvRc1d8dBT7kpw Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:36:50.441953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e75c5cf78474dfcb3c56cdaa26e9d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e75c5cf78474dfcb3c56cdaa26e9d44"}]}] Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 7e75c5cf78474dfcb3c56cdaa26e9d44 Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-22252300 Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 8fd4a5629fff47a69cf26196dbdee674 Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-ServerRescueNegativeTestJSON-22252300-project Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 could not be found. Nov 02 20:36:50.443704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '80aa0a2a-951c-4113-b7df-d2d32b966e13'} Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 could not be found. Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:50.444491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 could not be found. Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 could not be found. Nov 02 20:36:50.446726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:36:50.447828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] Returning 404 to user: Instance 80aa0a2a-951c-4113-b7df-d2d32b966e13 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:50.447828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-67c3f2ef-5e07-4154-928c-46bc4bd1c866 tempest-ServerRescueNegativeTestJSON-22252300 tempest-ServerRescueNegativeTestJSON-22252300-project] 10.222.0.26 "GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13" status: 404 len: 111 microversion: 2.1 time: 0.030966 Nov 02 20:36:50.448520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 340/679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:50 2022] GET /compute/v2.1/servers/80aa0a2a-951c-4113-b7df-d2d32b966e13 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:50.998009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1197746328", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27307d29-55f5-441e-b481-a0816c6cabad"}], "security_groups": [{"name": "tempest-securitygroup--764928552"}], "key_name": "tempest-keypair-1718274253", "user_data": "}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:51.102142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] validate_networks() for [('27307d29-55f5-441e-b481-a0816c6cabad', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:36:51.516412 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:36:51.516830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:36:51.517291 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:36:51.517719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:36:51.518120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:36:51.527025 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:51.527502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:51.527959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:51.528671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:51.529117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:51.529532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:51.547141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:36:51.551165 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Getting quotas for user aa1a7490162d4aeaa1f96da542fea26f and project 74c6156b36b1446b9c9a2320fe1f97fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:36:51.562704 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:36:51.565152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:36:51.614678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR oslo.messaging._drivers.impl_rabbit [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [a45f3da1-ba13-4eef-a569-128160d99ad1] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 20:36:52.627233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO oslo.messaging._drivers.impl_rabbit [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [a45f3da1-ba13-4eef-a569-128160d99ad1] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 52350. Nov 02 20:36:52.657919 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-78c47b7e-364a-4d70-b5fd-6f711a4e5517 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.661316 Nov 02 20:36:52.658706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 340/680] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:36:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:36:52.670276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6abb19b2-8c0e-479c-8bb2-5053abbef4b3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:52.671211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6abb19b2-8c0e-479c-8bb2-5053abbef4b3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:52.736342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6abb19b2-8c0e-479c-8bb2-5053abbef4b3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:52.745531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6abb19b2-8c0e-479c-8bb2-5053abbef4b3 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1238 microversion: 2.1 time: 0.079380 Nov 02 20:36:52.746100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 341/681] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:52 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:53.769066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:53.770324 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:53.777629 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:53.778120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:53.778738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:53.779636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:53.780273 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:53.781369 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:53.887342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:53.901631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-08124285-5378-4faf-b915-2db6c9f9f4bf tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1290 microversion: 2.1 time: 0.136239 Nov 02 20:36:53.903374 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 341/682] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:53 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1290 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:54.926176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:54.926786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:54.935267 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:54.936129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:54.936577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:54.937729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:54.938785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:54.939242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:54.964086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:55.189495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:55.200051 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-393979e2-29fc-4195-9ed8-ba304ee49746 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1363 microversion: 2.1 time: 0.277761 Nov 02 20:36:55.200634 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 342/683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:54 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:55.451781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f7485470-54ee-4350-810f-e660171c731b tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Action: 'create', calling method: .version_select at 0x7f2e22120310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1980008578", "metadata": {"Type": "work"}}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:55.601574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-74644030-f3f6-4312-8bcd-915c434f8c53 req-564fe210-5603-47bf-9afb-118bb4406568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09017390-da96-4b1a-881f-a512ba4d9e20", "tag": "96066662-2ec4-470e-9e1b-7f01306d74dd"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:36:55.611771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-74644030-f3f6-4312-8bcd-915c434f8c53 req-564fe210-5603-47bf-9afb-118bb4406568 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:55.612508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-74644030-f3f6-4312-8bcd-915c434f8c53 req-564fe210-5603-47bf-9afb-118bb4406568 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:55.613126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-74644030-f3f6-4312-8bcd-915c434f8c53 req-564fe210-5603-47bf-9afb-118bb4406568 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:55.627495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-74644030-f3f6-4312-8bcd-915c434f8c53 req-564fe210-5603-47bf-9afb-118bb4406568 service nova] Creating event network-changed:96066662-2ec4-470e-9e1b-7f01306d74dd for instance 09017390-da96-4b1a-881f-a512ba4d9e20 on hv-cinder-86236 Nov 02 20:36:55.634567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-74644030-f3f6-4312-8bcd-915c434f8c53 req-564fe210-5603-47bf-9afb-118bb4406568 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036646 Nov 02 20:36:55.635195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 343/684] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:55.778980 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f7485470-54ee-4350-810f-e660171c731b tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.458836 Nov 02 20:36:55.779891 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 342/685] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 20:36:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 460 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 20:36:55.793799 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d28838cd-2571-4c48-b80a-bd96d171a3ef tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Calling method '.version_select at 0x7f2e220bd280>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:55.850011 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d28838cd-2571-4c48-b80a-bd96d171a3ef tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee" status: 200 len: 353 microversion: 2.1 time: 0.060882 Nov 02 20:36:55.850590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 344/686] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:36:55 2022] GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:56.223419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:56.224069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:56.231182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:56.231685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:56.232118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:56.232800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:56.233253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:56.233674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:56.237708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:56.365521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:56.372386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-90c8baf0-3ae3-4c14-adb1-b29b05aa5121 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1363 microversion: 2.1 time: 0.152801 Nov 02 20:36:56.372954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 343/687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:56 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:56.864587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-de08f21d-1d26-4dfb-aa29-2934401496a8 tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Calling method '.version_select at 0x7f2e2237f8b0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:56.910421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-de08f21d-1d26-4dfb-aa29-2934401496a8 tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee" status: 200 len: 354 microversion: 2.1 time: 0.050118 Nov 02 20:36:56.910986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 345/688] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:36:56 2022] GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:56.924254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4aa05023-3260-4fdf-9557-b6077653fee5 tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Calling method '.version_select at 0x7f2e22069a60>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:56.970795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4aa05023-3260-4fdf-9557-b6077653fee5 tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee" status: 200 len: 354 microversion: 2.1 time: 0.050221 Nov 02 20:36:56.971355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 344/689] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:36:56 2022] GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:56.989653 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5cb7f215-2eed-4f06-942b-35ef7491f4df tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Calling method '.version_select at 0x7f2e220c5940>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:57.048486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5cb7f215-2eed-4f06-942b-35ef7491f4df tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee" status: 202 len: 0 microversion: 2.1 time: 0.062747 Nov 02 20:36:57.049052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 346/690] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:36:56 2022] DELETE /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:36:57.057244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e1117b89-b1d5-4836-8a21-d8c795d326df tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Calling method '.version_select at 0x7f2e22069e50>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:57.104890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e1117b89-b1d5-4836-8a21-d8c795d326df tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee" status: 200 len: 353 microversion: 2.1 time: 0.051673 Nov 02 20:36:57.105538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 345/691] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:36:57 2022] GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:36:57.394824 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:57.395550 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:57.402915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:57.403392 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:57.403888 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:57.405390 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:57.405864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:57.406297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:57.536173 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:57.543824 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1d93a794-cfad-435e-88fb-051bcd250161 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1363 microversion: 2.1 time: 0.152780 Nov 02 20:36:57.544430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 347/692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:57 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:58.120582 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2ac11294-0632-4407-8eac-7592c05f7b8a tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Calling method '.version_select at 0x7f2e220234c0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:58.148539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-2ac11294-0632-4407-8eac-7592c05f7b8a tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] HTTP exception thrown: Volume b884765d-0738-4224-b7d5-92bb2af84eee could not be found. Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2ac11294-0632-4407-8eac-7592c05f7b8a tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Request method failure captured: Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee HTTP/1.1 Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtTnA3Sb19sNgNLJSjSmvWFhb6rTYZYR5glc-ER_8pT9mT7zCboKNL2-5kc6HiKD_cWEOiCP6Sbts21G-BTUWfR81IncPRYNWRICTdaygbaNZkikFc0otANOfC_z3XGEqO-uQLXIzgpcTwfu3UWCB9bNZQRuYClyJoXziaoHzg9KZpM Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 2c0e95099d514d24b6a992bcdfa9a86f Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesGetTestJSON-1575375034 Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:36:58.150659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c0e95099d514d24b6a992bcdfa9a86f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c0e95099d514d24b6a992bcdfa9a86f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c0e95099d514d24b6a992bcdfa9a86f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c0e95099d514d24b6a992bcdfa9a86f"}]}] Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesGetTestJSON-1575375034 Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 2c0e95099d514d24b6a992bcdfa9a86f Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesGetTestJSON-1575375034 Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesGetTestJSON-1575375034-project Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 0ae5cb770b1f414d95a8aec9dd79350c Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesGetTestJSON-1575375034-project Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Volume b884765d-0738-4224-b7d5-92bb2af84eee could not be found. Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'b884765d-0738-4224-b7d5-92bb2af84eee'} Nov 02 20:36:58.152197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b884765d-0738-4224-b7d5-92bb2af84eee could not be found. (HTTP 404) (Request-ID: req-1b794f4c-8f54-437c-b3cb-3cf137304188) Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:58.153264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 20:36:58.154687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b884765d-0738-4224-b7d5-92bb2af84eee could not be found. Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 20:36:58.156379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b884765d-0738-4224-b7d5-92bb2af84eee could not be found. Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b884765d-0738-4224-b7d5-92bb2af84eee could not be found. Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2ac11294-0632-4407-8eac-7592c05f7b8a tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] Returning 404 to user: Volume b884765d-0738-4224-b7d5-92bb2af84eee could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2ac11294-0632-4407-8eac-7592c05f7b8a tempest-VolumesGetTestJSON-1575375034 tempest-VolumesGetTestJSON-1575375034-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee" status: 404 len: 109 microversion: 2.1 time: 0.036663 Nov 02 20:36:58.157746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 346/693] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:36:58 2022] GET /compute/v2.1/os-volumes/b884765d-0738-4224-b7d5-92bb2af84eee => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:58.566948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:58.568578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:58.575314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:58.576255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:58.576899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:58.578324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:58.579288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:58.579816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:58.808877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:36:58.816635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-774ef5c0-b1b8-42c0-a486-11c693f46a13 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1363 microversion: 2.1 time: 0.253778 Nov 02 20:36:58.817223 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 348/694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:58 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:36:59.840826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:36:59.841434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:36:59.843255 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:59.848673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:59.849150 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:59.849582 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:36:59.850262 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:36:59.850699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:36:59.851574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:00.000909 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:00.010117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-be69789f-4d4c-47f3-aa68-19dcaf23fe16 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1363 microversion: 2.1 time: 0.174147 Nov 02 20:37:00.010691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 347/695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:36:59 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:37:01.033678 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:01.034345 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:01.041286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:01.041759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:01.042191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:01.042885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:01.043336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:01.043799 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:01.058427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-c4594295-0afb-4544-a11c-f2145843a351 req-273602f6-965d-4f68-8802-5391cffb5cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09017390-da96-4b1a-881f-a512ba4d9e20", "name": "network-vif-plugged", "status": "completed", "tag": "96066662-2ec4-470e-9e1b-7f01306d74dd"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:01.069129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c4594295-0afb-4544-a11c-f2145843a351 req-273602f6-965d-4f68-8802-5391cffb5cde service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:01.069602 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c4594295-0afb-4544-a11c-f2145843a351 req-273602f6-965d-4f68-8802-5391cffb5cde service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:01.070255 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c4594295-0afb-4544-a11c-f2145843a351 req-273602f6-965d-4f68-8802-5391cffb5cde service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:01.085339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-c4594295-0afb-4544-a11c-f2145843a351 req-273602f6-965d-4f68-8802-5391cffb5cde service nova] Creating event network-vif-plugged:96066662-2ec4-470e-9e1b-7f01306d74dd for instance 09017390-da96-4b1a-881f-a512ba4d9e20 on hv-cinder-86236 Nov 02 20:37:01.090409 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-c4594295-0afb-4544-a11c-f2145843a351 req-273602f6-965d-4f68-8802-5391cffb5cde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036593 Nov 02 20:37:01.091000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 348/696] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:37:01.185695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:01.194195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2c365ce4-aea3-425c-88d9-3c8661585aa1 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1363 microversion: 2.1 time: 0.164383 Nov 02 20:37:01.194804 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 349/697] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:01 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:37:02.213752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:02.214521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=10 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:02.219175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:02.219900 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:02.226842 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:02.227311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:02.227779 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:02.228466 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:02.228917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:02.229336 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:02.357162 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:02.364722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6a425bce-3ade-48c6-bc21-adace2d04e2d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1363 microversion: 2.1 time: 0.151908 Nov 02 20:37:02.365295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 349/698] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:02 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:37:03.388073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:03.388713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:03.391091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:03.396784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:03.397261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:03.397687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:03.398547 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:03.399026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:03.399443 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:03.525179 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:03.532749 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-51a70094-22a5-431d-9a83-6273c3ee79df tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1549 microversion: 2.1 time: 0.148604 Nov 02 20:37:03.533313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 350/699] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:03 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:37:03.558164 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:03.558690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:03.564930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:03.565410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:03.565842 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:03.566527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:03.566979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:03.567398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:03.644961 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fe80176e-362a-462a-8135-b478c57d0a44 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091264 Nov 02 20:37:03.645562 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 350/700] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:37:03 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:37:04.583189 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-c1ed0511-26c9-4df7-aae5-eaa5a2732bd1 req-7c366781-448d-44d0-b64e-9f6e21444a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09017390-da96-4b1a-881f-a512ba4d9e20", "tag": "96066662-2ec4-470e-9e1b-7f01306d74dd"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:04.592911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-c1ed0511-26c9-4df7-aae5-eaa5a2732bd1 req-7c366781-448d-44d0-b64e-9f6e21444a3c service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:04.593992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-c1ed0511-26c9-4df7-aae5-eaa5a2732bd1 req-7c366781-448d-44d0-b64e-9f6e21444a3c service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:04.594431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-c1ed0511-26c9-4df7-aae5-eaa5a2732bd1 req-7c366781-448d-44d0-b64e-9f6e21444a3c service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:04.605460 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-c1ed0511-26c9-4df7-aae5-eaa5a2732bd1 req-7c366781-448d-44d0-b64e-9f6e21444a3c service nova] Creating event network-changed:96066662-2ec4-470e-9e1b-7f01306d74dd for instance 09017390-da96-4b1a-881f-a512ba4d9e20 on hv-cinder-86236 Nov 02 20:37:04.610478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-c1ed0511-26c9-4df7-aae5-eaa5a2732bd1 req-7c366781-448d-44d0-b64e-9f6e21444a3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030931 Nov 02 20:37:04.611069 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 351/701] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:37:42.095287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=7 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:42.095978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=22 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:42.100302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:42.101446 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:42.108589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:42.109065 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:42.109493 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:42.110178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:42.110629 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:42.111051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:42.133792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6ac12812-f321-472a-bd89-eba25fdc1a13 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/ips" status: 200 len: 148 microversion: 2.1 time: 0.040211 Nov 02 20:37:42.134350 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 351/702] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:37:42 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:37:43.471469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:43.472235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=30 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:43.477311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cd2816f-e2c7-421c-9943-6583da3bfa0b"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:43.479728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:43.487581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:43.488085 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:43.488519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:43.489205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:43.489658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:43.490080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:43.781624 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8bd4280f-c4fd-4da8-834c-d916552a74d0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312049 Nov 02 20:37:43.782219 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 352/703] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:37:43 2022] POST /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:37:46.345897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:46.346519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:46.353729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:46.354248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:46.354737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:46.355477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:46.356019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:46.356442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:46.379996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-df8b8178-d31a-4834-9ba5-2b2b0d275b6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/ips" status: 200 len: 153 microversion: 2.20 time: 0.037892 Nov 02 20:37:46.380549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 352/704] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Nov 2 20:37:46 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 20:37:49.520280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:49.520891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:49.527528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:49.528029 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:49.528461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:49.529143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:49.529590 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:49.530006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:49.556204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lazy-loading 'flavor' on Instance uuid eba7c8d9-10eb-437f-a0df-a276b941e16b {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:37:49.740157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e9aac333-50b3-44a5-a162-40c5e2cd64f7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/action" status: 202 len: 0 microversion: 2.20 time: 0.224450 Nov 02 20:37:49.740927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 353/705] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Nov 2 20:37:49 2022] POST /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:37:49.748809 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:49.749423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:49.755866 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:49.756344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:49.756779 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:49.758009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:49.758465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:49.758888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:49.885561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:49.894632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:49.896088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:49.897247 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1f0de4d1-66e1-425d-a28a-0348e1981a97 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.152348 Nov 02 20:37:49.897809 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 353/706] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:49 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:50.925184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:50.925894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:50.933070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:50.933532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:50.933966 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:50.934657 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:50.935099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:50.935517 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:51.063952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:51.072230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:51.073649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:51.074798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ed0bc925-24c3-4c13-a86b-fc037ffae57d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.154594 Nov 02 20:37:51.075346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 354/707] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:50 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:51.313080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cd2816f-e2c7-421c-9943-6583da3bfa0b"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:51.315465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:51.322899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:51.323378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:51.323838 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:51.324540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:51.324972 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:51.325388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:51.402066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Invalid volume: volume 1cd2816f-e2c7-421c-9943-6583da3bfa0b is already attached to instances: df50c4f6-8302-4c6e-8314-d3a70770bd44 Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: POST /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments HTTP/1.1 Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 74 Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:37:51.403819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {"volumeAttachment": {"volumeId": "1cd2816f-e2c7-421c-9943-6583da3bfa0b"}} Nov 02 20:37:51.405386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Invalid volume: volume 1cd2816f-e2c7-421c-9943-6583da3bfa0b is already attached to instances: df50c4f6-8302-4c6e-8314-d3a70770bd44 Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'server_id': 'df50c4f6-8302-4c6e-8314-d3a70770bd44', 'body': {'volumeAttachment': {'volumeId': '1cd2816f-e2c7-421c-9943-6583da3bfa0b'}}} Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1cd2816f-e2c7-421c-9943-6583da3bfa0b is already attached to instances: df50c4f6-8302-4c6e-8314-d3a70770bd44 Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:37:51.406191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1cd2816f-e2c7-421c-9943-6583da3bfa0b is already attached to instances: df50c4f6-8302-4c6e-8314-d3a70770bd44 Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:37:51.407591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1cd2816f-e2c7-421c-9943-6583da3bfa0b is already attached to instances: df50c4f6-8302-4c6e-8314-d3a70770bd44 Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 400 to user: Invalid volume: volume 1cd2816f-e2c7-421c-9943-6583da3bfa0b is already attached to instances: df50c4f6-8302-4c6e-8314-d3a70770bd44 {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-edf3b914-114f-4b1a-aabd-700b27ebf945 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096112 Nov 02 20:37:51.409038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 354/708] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:37:51 2022] POST /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:37:51.470494 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:51.470985 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:51.477304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:51.477776 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:51.478211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:51.478892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:51.479338 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:51.479784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:51.558742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lazy-loading 'services' on Instance uuid df50c4f6-8302-4c6e-8314-d3a70770bd44 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:37:51.627562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9131f3c6-dea6-4992-a211-d1612f188b4f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments/1cd2816f-e2c7-421c-9943-6583da3bfa0b" status: 202 len: 0 microversion: 2.1 time: 0.160872 Nov 02 20:37:51.628169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 355/709] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:37:51 2022] DELETE /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments/1cd2816f-e2c7-421c-9943-6583da3bfa0b => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:37:51.637168 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:51.639426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:51.645331 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:51.646037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:51.646611 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:51.647535 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:51.648125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:51.648578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:51.678823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-91c21407-e640-4c3b-86d4-72da48c90b72 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046261 Nov 02 20:37:51.680246 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 355/710] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:37:51 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:37:52.100382 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:52.101632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:52.107851 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.108337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.108766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:52.109452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.109903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.110318 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:52.240619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:52.249169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:52.250588 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:52.251768 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-eb46d86d-72aa-43df-b2df-eb8a5638f1a2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.155540 Nov 02 20:37:52.252322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 356/711] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:52 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:52.692394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:52.695283 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:52.701524 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.702020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.702485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:52.703184 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.703658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.704083 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:52.734023 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-259a4a34-6c10-470d-9ace-5e33fdad3439 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045512 Nov 02 20:37:52.734454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 356/712] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:37:52 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:37:52.796495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:52.796984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:52.803174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.803693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.804160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:52.804945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.805399 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.805818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:52.832623 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:37:52.905331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ee4365f1-a9f7-4d45-a713-b2ce5284b902 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 204 len: 0 microversion: 2.1 time: 0.112372 Nov 02 20:37:52.905932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 357/713] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:37:52 2022] DELETE /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:37:52.914269 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:52.914839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:52.920677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.921155 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.921584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:52.922269 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:52.922719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:52.923140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:53.052216 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:53.060517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1ef5a20e-5d2e-4a01-a71c-b3bc1b2f3b9f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1678 microversion: 2.1 time: 0.150154 Nov 02 20:37:53.061079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 357/714] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:52 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:37:53.277435 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:53.278045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:53.283879 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:53.284355 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:53.284785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:53.285468 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:53.285916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:53.286332 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:53.413579 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:53.422131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:53.423561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:53.424731 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-900382c1-5664-4ec3-b404-1f5b09451de4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.151610 Nov 02 20:37:53.425289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 358/715] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:53 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:54.084091 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:54.084594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:54.091258 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:54.091826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:54.092258 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:54.092934 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:54.093381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:54.093798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:54.226279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:54.234393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bf33f31a-d342-4aa1-8b38-c1da020e2e30 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1678 microversion: 2.1 time: 0.154285 Nov 02 20:37:54.234954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 358/716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:54 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:37:54.452294 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:54.452986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:54.459430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:54.459938 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:54.460359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:54.461036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:54.461480 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:54.461894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:54.593331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:54.601264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:54.602687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:54.603855 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2beae863-b22a-4075-b345-43d28044b282 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.155488 Nov 02 20:37:54.604404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 359/717] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:54 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:55.257891 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:55.258508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:55.266597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:55.267120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:55.267627 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:55.268363 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:55.268822 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:55.269249 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:55.399526 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:55.408234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ebe567c1-53f0-4948-a72b-8622813bc0c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1678 microversion: 2.1 time: 0.154193 Nov 02 20:37:55.408802 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 359/718] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:55 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:37:55.629010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:55.629641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:55.636024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:55.636502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:55.636932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:55.638172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:55.638701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:55.639125 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:55.896624 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:55.905502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:55.906918 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:55.908111 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9dfeee61-12ed-4d04-903c-85d3462ef62a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.283037 Nov 02 20:37:55.908670 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 360/719] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:55 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:56.432251 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:56.432857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:56.441348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:56.441837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:56.442278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:56.444009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:56.444471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:56.445719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:56.517970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:56.525892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-da5bddca-e8ab-41d6-9d33-1c0dd8331b6b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 200 len: 1611 microversion: 2.1 time: 0.097514 Nov 02 20:37:56.526467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 360/720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:56 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 1611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:37:56.647482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-482090a1-0601-47b0-bdbf-12211f6638e0 req-0b5e82e2-2abe-45d4-814f-56a904756a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df50c4f6-8302-4c6e-8314-d3a70770bd44", "name": "network-vif-deleted", "tag": "e0d6d41e-4672-44fe-af9d-07f08384ab60"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:56.663477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-482090a1-0601-47b0-bdbf-12211f6638e0 req-0b5e82e2-2abe-45d4-814f-56a904756a7e service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:56.664404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-482090a1-0601-47b0-bdbf-12211f6638e0 req-0b5e82e2-2abe-45d4-814f-56a904756a7e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:56.664946 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-482090a1-0601-47b0-bdbf-12211f6638e0 req-0b5e82e2-2abe-45d4-814f-56a904756a7e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:56.680676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-482090a1-0601-47b0-bdbf-12211f6638e0 req-0b5e82e2-2abe-45d4-814f-56a904756a7e service nova] Creating event network-vif-deleted:e0d6d41e-4672-44fe-af9d-07f08384ab60 for instance df50c4f6-8302-4c6e-8314-d3a70770bd44 on hv-cinder-86236 Nov 02 20:37:56.691384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-482090a1-0601-47b0-bdbf-12211f6638e0 req-0b5e82e2-2abe-45d4-814f-56a904756a7e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047197 Nov 02 20:37:56.692100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 361/721] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:37:56.933623 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:56.934974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:56.944197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:56.944683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:56.945109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:56.945924 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:56.946372 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:56.946801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:57.082846 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:57.091192 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:57.092653 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:57.093883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-321199cd-5af1-410d-801d-908144108aa4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.164202 Nov 02 20:37:57.094450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 361/722] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:56 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:37:57.553515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:57.554469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:57.561265 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:57.561675 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:57.562102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:57.562796 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:57.563243 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:57.563677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:57.577716 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 HTTP/1.1 Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:37:57.579328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:37:57.580932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'df50c4f6-8302-4c6e-8314-d3a70770bd44'} Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:37:57.581817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:37:57.583275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:37:57.585131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:37:57.585131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0090c176-b77e-470b-b0a8-6e4c83914dfd tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 404 len: 111 microversion: 2.1 time: 0.031585 Nov 02 20:37:57.585131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 362/723] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:37:57 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:37:57.589680 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-16897c98-9950-49da-94b8-e6569819e774 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '.version_select at 0x7f2e2211c9d0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:57.609471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-16897c98-9950-49da-94b8-e6569819e774 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682639802" status: 202 len: 0 microversion: 2.1 time: 0.023448 Nov 02 20:37:57.610062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 362/724] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Nov 2 20:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682639802 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:37:58.120089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:58.120703 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:58.129396 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:58.129886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:58.130351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:58.131050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:58.131508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:58.131966 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:58.276981 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bccae47c-511e-4f0d-95d2-78b983648bc0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: .version_select at 0x7f2e22084430>, body: {"keypair": {"name": "tempest-keypair-1244150046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD0skMfuUs9X4lDI6FrRovHN580JEn4oouhA0KUniWAINf6xxiSBvf2AQGiOGyppMqgFUMMdFXQFApzDU2FfKMTzqvXxz9TYn6N9TzoM4vqo9/LggBd6igFfFfHki8myw=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:58.293608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-bccae47c-511e-4f0d-95d2-78b983648bc0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:37:58.298417 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-bccae47c-511e-4f0d-95d2-78b983648bc0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:37:58.306527 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:58.315021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:58.316577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:58.317742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-89acc681-4444-4ef0-a617-3a1468f9e96a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.201660 Nov 02 20:37:58.318778 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 363/725] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:58 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:58.325511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bccae47c-511e-4f0d-95d2-78b983648bc0 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052394 Nov 02 20:37:58.326115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 363/726] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:37:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:37:59.344171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:37:59.344901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:37:59.351124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:59.351602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:59.352062 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:59.352841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:37:59.353293 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:37:59.353710 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:37:59.358078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:59.569263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:59.578234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:59.579839 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:37:59.580998 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6de4b294-9239-43de-8738-ad8b510c1bc8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.241511 Nov 02 20:37:59.581971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 364/727] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:37:59 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:37:59.656883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1730728187", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb4fd267-779a-4c9f-9357-f71bbe07a717"}], "security_groups": [{"name": "tempest-securitygroup--390156676"}], "key_name": "tempest-keypair-1244150046", "user_data": "}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:37:59.775794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] validate_networks() for [('eb4fd267-779a-4c9f-9357-f71bbe07a717', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:38:00.350722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:38:00.351170 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:38:00.351679 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:38:00.352095 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:38:00.352545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:38:00.361927 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:00.362409 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:00.362844 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:00.363569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:00.364064 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:00.364483 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:00.381384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:38:00.385308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Getting quotas for user 89876cb8e3a040eca4ec8d15a2df0cae and project e1f7a92134ad4771991bf954e6278efe. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:38:00.396337 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:38:00.398664 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:38:00.446502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f30e9bc3-c1b7-44ac-8e62-c201abb1fad8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.794565 Nov 02 20:38:00.447149 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 364/728] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:37:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:38:00.458140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ec75d2d8-196a-4f54-b8e0-1e2b748c115e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:00.458874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ec75d2d8-196a-4f54-b8e0-1e2b748c115e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:00.514311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ec75d2d8-196a-4f54-b8e0-1e2b748c115e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:00.520971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ec75d2d8-196a-4f54-b8e0-1e2b748c115e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1242 microversion: 2.1 time: 0.066644 Nov 02 20:38:00.521537 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 365/729] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:00 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:00.607266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:00.607921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:00.614806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:00.615297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:00.615756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:00.616452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:00.616909 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:00.617333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:00.754211 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:00.762532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:00.764177 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:00.765434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6ea0a6fc-13d8-427b-9412-07168c75de05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.162304 Nov 02 20:38:00.765988 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 365/730] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:00 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:01.545445 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:01.546058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:01.552563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:01.553043 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:01.553473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:01.554157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:01.554610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:01.555030 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:01.614659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:01.622370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-84aa6dbf-2e8d-4495-b01d-6777b42eb2bb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1246 microversion: 2.1 time: 0.081906 Nov 02 20:38:01.622936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 366/731] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:01 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:01.791668 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:01.792274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:01.799253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:01.799760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:01.800186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:01.800864 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:01.801310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:01.801725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:01.929492 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:01.938755 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:01.940243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:01.941415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-920ec263-8815-4f87-ac04-9b30f5a5b045 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.153794 Nov 02 20:38:01.941965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 366/732] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:01 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:02.644563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:02.645221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:02.651512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:02.652028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:02.652494 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:02.653864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:02.654247 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:02.654668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:02.716434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:02.723857 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-17ec2816-6eb1-47e0-9887-d2c666c9bcea tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1246 microversion: 2.1 time: 0.083089 Nov 02 20:38:02.724433 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 367/733] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:02 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:02.970338 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:02.970782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:02.976887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:02.977363 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:02.977786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:02.978464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:02.978909 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:02.979324 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:03.108048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:03.115981 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:03.117419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:03.118573 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8c576b13-65f3-44ec-9b63-c4e966f4b7b9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.152262 Nov 02 20:38:03.119242 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 367/734] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:02 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:03.746296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:03.746905 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:03.753582 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:03.754061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:03.754510 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:03.755172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:03.755640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:03.756072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:03.820272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:03.828371 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cb115968-f6c9-4f16-95ac-d97ee161a27e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1246 microversion: 2.1 time: 0.085974 Nov 02 20:38:03.828938 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 368/735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:03 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:04.145497 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:04.146110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:04.152514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:04.152994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:04.154231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:04.154920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:04.155382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:04.155826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:04.286252 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:04.294643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:04.296108 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:04.297278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-515322cc-7cba-41d7-9a87-d0c86f884d69 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.156431 Nov 02 20:38:04.297832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 368/736] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:04 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:04.852051 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:04.852778 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:04.859495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:04.860021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:04.860620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:04.861158 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:04.861612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:04.862036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:04.933341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:04.941633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-616db307-dfbe-4863-8c78-ee0b3255b8f4 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1300 microversion: 2.1 time: 0.093437 Nov 02 20:38:04.952349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 369/737] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:04 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:05.322564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:05.323165 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:05.330274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:05.330747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:05.331173 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:05.331884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:05.332333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:05.332748 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:05.458882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:05.466909 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:05.468387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:05.469547 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4ef08a97-fb74-4ee9-81da-5d728e0942ec tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.150833 Nov 02 20:38:05.470103 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 369/738] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:05 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:05.966354 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:05.967263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:05.974151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:05.974785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:05.975369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:05.976102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:05.976567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:05.977018 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:06.053676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:06.061428 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9b837ad4-7a55-4083-8714-7810fef313d2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1300 microversion: 2.1 time: 0.099964 Nov 02 20:38:06.062001 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 370/739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:05 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:06.495545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:06.496181 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:06.503305 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:06.503814 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:06.504244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:06.504925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:06.505556 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:06.505975 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:06.647540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:06.651153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:06.657844 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:06.659283 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:06.660502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6930a61d-cd09-4a83-b799-767cf68c4f32 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.168952 Nov 02 20:38:06.661062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 370/740] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:06 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:07.062329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-d91b44c5-d441-4003-8805-28eeaccd7858 req-9797a2d7-36d4-4c0a-b185-53d9b17d677a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3074dbb7-dbe0-41cf-ad30-4671f3099eb5", "tag": "16b71ca4-6bda-4703-8d12-3bf13b153abe"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:07.072636 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d91b44c5-d441-4003-8805-28eeaccd7858 req-9797a2d7-36d4-4c0a-b185-53d9b17d677a service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:07.073254 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d91b44c5-d441-4003-8805-28eeaccd7858 req-9797a2d7-36d4-4c0a-b185-53d9b17d677a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:07.074143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d91b44c5-d441-4003-8805-28eeaccd7858 req-9797a2d7-36d4-4c0a-b185-53d9b17d677a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:07.086066 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-d91b44c5-d441-4003-8805-28eeaccd7858 req-9797a2d7-36d4-4c0a-b185-53d9b17d677a service nova] Creating event network-changed:16b71ca4-6bda-4703-8d12-3bf13b153abe for instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 on hv-cinder-86236 Nov 02 20:38:07.086608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:07.087288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:07.092016 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-d91b44c5-d441-4003-8805-28eeaccd7858 req-9797a2d7-36d4-4c0a-b185-53d9b17d677a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033250 Nov 02 20:38:07.092457 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 371/741] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:38:07.094307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:07.094855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:07.095291 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:07.096012 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:07.096462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:07.096882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:07.230051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:07.238237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ee0d3bec-2839-4fb1-9b46-8279137c281a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.156770 Nov 02 20:38:07.238815 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 371/742] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:07 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:07.687279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:07.687936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:07.694270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:07.694749 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:07.695182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:07.695892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:07.696345 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:07.696767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:07.827979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:07.836053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:07.837474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:07.838610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-335bd6d8-91cc-4997-8da8-da3c532537a8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.155935 Nov 02 20:38:07.839196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 372/743] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:07 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:08.261109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:08.261722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:08.268469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:08.268953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:08.269387 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:08.270075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:08.270527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:08.270946 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:08.399843 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:08.408006 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ed442ac9-2546-461d-a907-e1aa900bcbe9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.150651 Nov 02 20:38:08.408587 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 372/744] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:08 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:08.864897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:08.865448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:08.872314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:08.872855 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:08.873211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:08.873892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:08.874331 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:08.874743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:09.003303 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:09.011335 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:09.013404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:09.014564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-727056df-41e6-4959-a6fd-3138f2bc978f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.153670 Nov 02 20:38:09.015128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 373/745] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:08 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:09.431718 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:09.432332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:09.439040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:09.439531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:09.439983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:09.440679 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:09.441132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:09.441594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:09.582593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:09.591632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0716d1fa-986b-483d-b73e-1f4b0d74ee6a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.163196 Nov 02 20:38:09.592436 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 373/746] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:09 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:10.040289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:10.040843 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:10.048254 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:10.048735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:10.049168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:10.049915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:10.050369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:10.050787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:10.186437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:10.194642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:10.196108 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:10.197266 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-249047bc-4558-43d5-9487-3387f5b6abee tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.160977 Nov 02 20:38:10.197820 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 374/747] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:10 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:10.615697 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:10.616329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:10.618135 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:10.618803 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=10 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:10.625853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:10.626327 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:10.626747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:10.627430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:10.627902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:10.628316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:10.760060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:10.768966 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-39876dfe-0102-4edc-b43d-ca93d95e1e94 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.157001 Nov 02 20:38:10.769837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 374/748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:10 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:11.222578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:11.223179 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:11.225139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:11.230583 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:11.231715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:11.232217 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:11.232908 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:11.233362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:11.233803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:11.368488 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:11.376654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:11.378142 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:11.379290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-68007822-5bb5-4354-a322-254cb42cbb17 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.160606 Nov 02 20:38:11.379876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 375/749] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:11 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:11.423134 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-6d23b14f-f0df-47a7-86df-e91677965b6a req-9879cc93-1736-47e8-8dee-8c8ac1f0f6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba7c8d9-10eb-437f-a0df-a276b941e16b", "name": "network-vif-plugged", "status": "completed", "tag": "988104f9-4cc4-40c6-a3d5-9b7b5b41c840"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:11.433950 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6d23b14f-f0df-47a7-86df-e91677965b6a req-9879cc93-1736-47e8-8dee-8c8ac1f0f6f1 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:11.434434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6d23b14f-f0df-47a7-86df-e91677965b6a req-9879cc93-1736-47e8-8dee-8c8ac1f0f6f1 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:11.434858 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6d23b14f-f0df-47a7-86df-e91677965b6a req-9879cc93-1736-47e8-8dee-8c8ac1f0f6f1 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:11.446870 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-6d23b14f-f0df-47a7-86df-e91677965b6a req-9879cc93-1736-47e8-8dee-8c8ac1f0f6f1 service nova] Creating event network-vif-plugged:988104f9-4cc4-40c6-a3d5-9b7b5b41c840 for instance eba7c8d9-10eb-437f-a0df-a276b941e16b on hv-cinder-86236 Nov 02 20:38:11.452469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-6d23b14f-f0df-47a7-86df-e91677965b6a req-9879cc93-1736-47e8-8dee-8c8ac1f0f6f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033135 Nov 02 20:38:11.453411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 375/750] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:11.792056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:11.792659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:11.798529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:11.798998 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:11.799427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:11.800132 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:11.800580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:11.800996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:11.925579 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:11.933070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-99c7dec6-242c-43d6-838c-a805a560ae0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.144813 Nov 02 20:38:11.933647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 376/751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:11 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:12.406397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:12.407094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:12.409033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:12.414358 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:12.414838 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:12.415265 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:12.415979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:12.416432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:12.416853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:12.547190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:12.555151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:12.556616 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:12.557769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-395d914e-461b-48fb-b6c8-338e027f8b2b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.156864 Nov 02 20:38:12.558321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 376/752] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:12 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:12.957058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:12.957664 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:12.964031 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:12.964528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:12.964956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:12.966338 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:12.966967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:12.967436 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:13.101177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:13.109092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a91b2d44-5de4-42cb-be1a-26e34c9d89de tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.155882 Nov 02 20:38:13.109664 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 377/753] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:12 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:13.585046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:13.585632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:13.592770 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:13.593250 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:13.593678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:13.594363 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:13.594815 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:13.595259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:13.724370 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:13.732584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:13.734174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:13.735157 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2e7f651a-5497-44f1-b601-c8d54af75d9d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.154118 Nov 02 20:38:13.735743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 377/754] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:13 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:14.132549 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:14.133150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:14.135405 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:14.143413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:14.144238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:14.144801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:14.145709 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:14.146444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:14.146941 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:14.294943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:14.302505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0854f0c9-5e52-4f91-8c7a-78611928a30e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.173831 Nov 02 20:38:14.303065 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 378/755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:14 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:14.760712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:14.761321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:14.768590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:14.769076 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:14.769523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:14.770182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:14.770636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:14.771055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:14.904135 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:14.912115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:14.913548 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:14.914705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6bb6592b-cb76-422e-b8a7-2b3f5ffadaae tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.157899 Nov 02 20:38:14.915260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 378/756] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:14 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:15.326013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:15.326708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:15.333363 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:15.333882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:15.334332 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:15.335068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:15.335545 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:15.336025 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:15.469389 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:15.477235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c6ed26a7-af7b-494b-830e-beb1a4dfe98a tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.155468 Nov 02 20:38:15.478035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 379/757] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:15 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:15.940624 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:15.941235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:15.947907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:15.948388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:15.948820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:15.949504 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:15.950464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:15.950867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:16.091433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:16.099828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:16.101447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:16.102733 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-549ee501-7942-445d-80b5-6f965a2eed3f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.165973 Nov 02 20:38:16.103333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 379/758] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:15 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:16.500859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:16.501474 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:16.507369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:16.507904 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:16.508326 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:16.509016 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:16.509472 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:16.509895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:16.642281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:16.649766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2154011c-d3c3-4d7b-a869-98afe2b7b687 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.153747 Nov 02 20:38:16.650324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 380/759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:16 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:17.131883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:17.132651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:17.141152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:17.141908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:17.142427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:17.143309 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:17.143952 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:17.144450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:17.284666 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:17.292755 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:17.294408 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:17.295558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9db6c8d5-b239-4346-a2c1-a2846cc8014d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1747 microversion: 2.20 time: 0.168682 Nov 02 20:38:17.296135 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 380/760] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:17 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:17.674483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:17.675091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:17.685136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:17.685635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:17.686115 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:17.687760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:17.688267 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:17.688694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:17.892312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-8be8f934-2287-49fd-a343-a8b28bd79329 req-c4758beb-9a5a-482c-aa46-19f8239bd185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3074dbb7-dbe0-41cf-ad30-4671f3099eb5", "name": "network-vif-plugged", "status": "completed", "tag": "16b71ca4-6bda-4703-8d12-3bf13b153abe"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:17.903573 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8be8f934-2287-49fd-a343-a8b28bd79329 req-c4758beb-9a5a-482c-aa46-19f8239bd185 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:17.904483 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8be8f934-2287-49fd-a343-a8b28bd79329 req-c4758beb-9a5a-482c-aa46-19f8239bd185 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:17.905082 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-8be8f934-2287-49fd-a343-a8b28bd79329 req-c4758beb-9a5a-482c-aa46-19f8239bd185 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:17.919086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-8be8f934-2287-49fd-a343-a8b28bd79329 req-c4758beb-9a5a-482c-aa46-19f8239bd185 service nova] Creating event network-vif-plugged:16b71ca4-6bda-4703-8d12-3bf13b153abe for instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 on hv-cinder-86236 Nov 02 20:38:17.925214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-8be8f934-2287-49fd-a343-a8b28bd79329 req-c4758beb-9a5a-482c-aa46-19f8239bd185 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038448 Nov 02 20:38:17.926678 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 381/761] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:38:17.947032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:17.956894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f9a3ab3d-5495-43f1-87d1-87230fa75958 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.286426 Nov 02 20:38:17.958180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 381/762] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:17 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:18.322533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:18.323392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:18.331130 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:18.331951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:18.332620 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:18.333426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:18.334107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:18.334727 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:18.496222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:18.510008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:18.512417 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:18.514651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1c2c319b-8b47-4209-becc-8231a65ebb6f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.196588 Nov 02 20:38:18.535645 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 382/763] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:18 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:18.981900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:18.982836 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:18.990148 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:18.990769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:18.991253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:18.992400 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:18.993007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:18.993567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:19.015920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:19.162268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:19.171280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-30ff19ea-f27a-451c-b1f0-497dccac75ad tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1367 microversion: 2.1 time: 0.194023 Nov 02 20:38:19.172555 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 382/764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:18 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:19.547326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:19.548756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:19.555507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:19.556351 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:19.557186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:19.558257 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:19.558880 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:19.559890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:19.738301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:19.747835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:19.749303 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:19.750506 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2aa09ab2-3969-42b4-af4d-8ae5a16b9e28 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.208180 Nov 02 20:38:19.751072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 383/765] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:19 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:20.197593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:20.198445 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:20.205142 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:20.205871 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:20.206313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:20.207010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:20.207461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:20.207969 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:20.374667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:20.391469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7aa99c2e-2b16-4af7-9062-f04edf9f3ed5 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1556 microversion: 2.1 time: 0.197896 Nov 02 20:38:20.392087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 383/766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:20 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:20.415832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:20.416319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:20.423121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:20.423597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:20.424042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:20.424724 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:20.425170 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:20.425584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:20.530451 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9b2912b0-4ee4-4309-8b14-7c040ae98436 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118467 Nov 02 20:38:20.531660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 384/767] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 20:38:20 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:20.782798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:20.783439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:20.789489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:20.790168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:20.791761 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:20.793012 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:20.795099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:20.796015 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:21.071398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:21.083484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:21.085753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:21.087640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0f772844-1204-414d-b884-81b6acbe7e63 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.309602 Nov 02 20:38:21.088911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 384/768] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:20 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:21.867115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-625a9a97-6d01-44e8-8f06-4616bcbd9ab4 req-cf5fdbde-c5b5-4151-843f-9d47ebe36b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3074dbb7-dbe0-41cf-ad30-4671f3099eb5", "tag": "16b71ca4-6bda-4703-8d12-3bf13b153abe"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:21.878847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-625a9a97-6d01-44e8-8f06-4616bcbd9ab4 req-cf5fdbde-c5b5-4151-843f-9d47ebe36b1a service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:21.879407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-625a9a97-6d01-44e8-8f06-4616bcbd9ab4 req-cf5fdbde-c5b5-4151-843f-9d47ebe36b1a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:21.880407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-625a9a97-6d01-44e8-8f06-4616bcbd9ab4 req-cf5fdbde-c5b5-4151-843f-9d47ebe36b1a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:21.893918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-625a9a97-6d01-44e8-8f06-4616bcbd9ab4 req-cf5fdbde-c5b5-4151-843f-9d47ebe36b1a service nova] Creating event network-changed:16b71ca4-6bda-4703-8d12-3bf13b153abe for instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 on hv-cinder-86236 Nov 02 20:38:21.899708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-625a9a97-6d01-44e8-8f06-4616bcbd9ab4 req-cf5fdbde-c5b5-4151-843f-9d47ebe36b1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036893 Nov 02 20:38:21.904654 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 385/769] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:22.124973 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:22.127102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:22.148668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:22.149349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:22.151227 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:22.151985 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:22.153594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:22.154230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:22.377228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:22.386531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:22.388336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:22.389705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ae86fe9a-694a-4d28-8b5a-be5d6709683c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.276611 Nov 02 20:38:22.390280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 385/770] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:22 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:23.421091 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:23.422566 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:23.431985 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:23.432718 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:23.433472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:23.435040 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:23.435548 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:23.436259 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:23.605237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:23.614742 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:23.616351 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:23.617641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0ddee425-e317-4ebd-b56c-9c931b27776e tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.202245 Nov 02 20:38:23.618297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 386/771] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:23 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:24.647798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:24.649128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:24.658629 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:24.659497 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:24.660176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:24.661250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:24.662726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:24.663378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:24.903807 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:24.913007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:24.915546 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:24.917388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-51720097-394b-4b1c-8604-dd180ca611be tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.274817 Nov 02 20:38:24.919270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 386/772] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:24 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:25.944110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:25.945515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:25.952522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:25.953214 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:25.953776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:25.954575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:25.955081 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:25.955530 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:26.102563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:26.113379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:26.115164 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:26.117352 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c0d20685-e269-42ea-a0fe-1534c44acc0f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.176786 Nov 02 20:38:26.132358 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 387/773] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:25 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:26.920034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1351663855", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "networks": [{"uuid": "8fff70e5-c2da-457b-a6d0-ebb221f9f423"}]}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:26.978897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] validate_networks() for [('8fff70e5-c2da-457b-a6d0-ebb221f9f423', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:38:27.145528 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:27.146281 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:27.153407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:27.154764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:27.155795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:27.157183 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:27.157839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:27.158466 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:27.348075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:27.357935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:27.359643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:27.361026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b67a66da-4996-42fa-b1e5-5cde8e41339f tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.220253 Nov 02 20:38:27.361914 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 388/774] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:27 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:27.373908 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:38:27.374540 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:38:27.375177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:38:27.375768 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:38:27.376321 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:38:27.388466 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:27.389098 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:27.389643 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:27.390499 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:27.391032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:27.391725 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:27.409603 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Getting quotas for project 0986044b31c543f6abc0adecffefb929. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:38:27.415698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Getting quotas for user 7c5ace8b734d4304bf68ccf9436a702f and project 0986044b31c543f6abc0adecffefb929. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:38:27.429509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:38:27.431981 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:38:27.489576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8c603190-3997-419e-8c4d-86c0d9c4b7ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573057 Nov 02 20:38:27.490611 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 387/775] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:38:27.502257 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d5a1882c-f60a-4d82-b4f9-7ab59672d8f9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:27.503043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d5a1882c-f60a-4d82-b4f9-7ab59672d8f9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:27.572325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d5a1882c-f60a-4d82-b4f9-7ab59672d8f9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:27.595928 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d5a1882c-f60a-4d82-b4f9-7ab59672d8f9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1219 microversion: 2.1 time: 0.097624 Nov 02 20:38:27.596521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 389/776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:27 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:28.387676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:28.388532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:28.394940 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:28.395381 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:28.395895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:28.396562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:28.397198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:28.397544 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:28.539694 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:28.548652 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:28.550506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:28.551347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bfb5ec6b-1399-4a2e-ba57-bd30fbf5954d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1742 microversion: 2.20 time: 0.168429 Nov 02 20:38:28.551986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 388/777] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:28 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:28.618257 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:28.618852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:28.625300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:28.625775 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:28.626200 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:28.626882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:28.627332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:28.627774 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:28.842759 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:28.846241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=100 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:28.851058 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a0517fc7-49fd-4189-93eb-deed729c5b8f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1271 microversion: 2.1 time: 0.236565 Nov 02 20:38:28.851621 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 390/778] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:28 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:29.577954 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:29.578615 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:29.585113 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:29.585595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:29.586028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:29.586716 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:29.587169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:29.587599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:29.874794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:29.875323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:29.882006 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:29.882593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:29.883036 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:29.883778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:29.884193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:29.884320 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:29.884649 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:29.893626 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:29.895182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:29.896431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4b4c0533-2c0b-443e-ba8a-222831572cc7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1724 microversion: 2.20 time: 0.322975 Nov 02 20:38:29.897104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 389/779] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:29 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:29.945964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:29.954298 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5c0d60db-60af-4be2-9ccc-60950020a5ab tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1277 microversion: 2.1 time: 0.084153 Nov 02 20:38:29.954865 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 391/780] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:29 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:30.922126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:30.922835 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:30.930443 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:30.930995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:30.932291 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:30.932983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:30.933437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:30.933852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:30.976894 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:30.977494 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:30.984099 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:30.984575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:30.984999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:30.985694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:30.986140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:30.986553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:31.091518 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:31.099566 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:31.101033 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:31.102195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-03a925a6-fb6e-43df-aaef-85cb7f7d737a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1724 microversion: 2.20 time: 0.184113 Nov 02 20:38:31.102756 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 390/781] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:30 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:31.118223 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:31.125910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b8b5c49c-e37e-4f8a-96e3-acd3a5001bf0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.152769 Nov 02 20:38:31.126457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 392/782] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:30 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:32.128816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:32.129435 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:32.135779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:32.136260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:32.136693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:32.137489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:32.137938 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:32.138357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:32.148795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:32.149407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:32.155885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:32.156409 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:32.156838 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:32.157523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:32.157970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:32.158390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:32.285886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:32.288386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:32.295139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:32.296607 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:32.296936 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c746f9a3-17c0-43cc-8c10-745bc06f61e2 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.151912 Nov 02 20:38:32.297506 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 393/783] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:32 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:32.300989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7e47c4aa-532e-4fc6-b72c-9a27a2bc39e3 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1724 microversion: 2.20 time: 0.172996 Nov 02 20:38:32.300989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 391/784] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:32 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:33.033962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-7817de35-c542-42f3-800c-27b0f522443d req-0cd7fbb8-b77d-41f6-b977-ecb9ce5652e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d75006-47d5-4d23-abe5-82c5074325e6", "tag": "f9d49564-9c92-410c-97b4-2a2a77c43e15"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:33.043894 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7817de35-c542-42f3-800c-27b0f522443d req-0cd7fbb8-b77d-41f6-b977-ecb9ce5652e9 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.044479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7817de35-c542-42f3-800c-27b0f522443d req-0cd7fbb8-b77d-41f6-b977-ecb9ce5652e9 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.044791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7817de35-c542-42f3-800c-27b0f522443d req-0cd7fbb8-b77d-41f6-b977-ecb9ce5652e9 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.055079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-7817de35-c542-42f3-800c-27b0f522443d req-0cd7fbb8-b77d-41f6-b977-ecb9ce5652e9 service nova] Creating event network-changed:f9d49564-9c92-410c-97b4-2a2a77c43e15 for instance 01d75006-47d5-4d23-abe5-82c5074325e6 on hv-cinder-86236 Nov 02 20:38:33.060075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-7817de35-c542-42f3-800c-27b0f522443d req-0cd7fbb8-b77d-41f6-b977-ecb9ce5652e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029604 Nov 02 20:38:33.060823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 394/785] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:33.320004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:33.320522 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:33.326304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:33.327014 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:33.327850 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.328335 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.328766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.329614 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.330061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.330486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.333372 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.333911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.334531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.335225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.336069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.336683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.471393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:33.480162 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:33.482362 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:33.483554 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-defe336a-526e-43cf-a720-3b856833d69c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1667 microversion: 2.20 time: 0.162840 Nov 02 20:38:33.484134 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 395/786] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:33 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:33.508778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c76e34d9-79f9-42a6-823a-cdccb917d490"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:33.511094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:33.517191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.517676 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.518302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.518996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.519449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.519900 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.537125 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:33.545290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-faf0d14f-a792-42bb-b1ad-0c9b33fb1db1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.229482 Nov 02 20:38:33.546188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 392/787] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:33 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:33.812982 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-39b0fa71-1c5a-4937-a6b2-2b0bdaeab753 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308052 Nov 02 20:38:33.813925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 396/788] 10.222.0.26 () {62 vars in 1364 bytes} [Wed Nov 2 20:38:33 2022] POST /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 20:38:33.885992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-c331d8ab-3a32-4a82-b5cd-a548881a46fc req-4c98b1ce-9a3c-4c6b-8347-3abe71272baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba7c8d9-10eb-437f-a0df-a276b941e16b", "name": "network-vif-unplugged", "status": "completed", "tag": "988104f9-4cc4-40c6-a3d5-9b7b5b41c840"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:33.900539 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-c331d8ab-3a32-4a82-b5cd-a548881a46fc req-4c98b1ce-9a3c-4c6b-8347-3abe71272baf service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.901384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-c331d8ab-3a32-4a82-b5cd-a548881a46fc req-4c98b1ce-9a3c-4c6b-8347-3abe71272baf service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.901824 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-c331d8ab-3a32-4a82-b5cd-a548881a46fc req-4c98b1ce-9a3c-4c6b-8347-3abe71272baf service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.916360 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.compute.server_external_events [req-c331d8ab-3a32-4a82-b5cd-a548881a46fc req-4c98b1ce-9a3c-4c6b-8347-3abe71272baf service nova] Unable to find a host for instance eba7c8d9-10eb-437f-a0df-a276b941e16b. Dropping event network-vif-unplugged {{(pid=118986) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 20:38:33.917258 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-c331d8ab-3a32-4a82-b5cd-a548881a46fc req-4c98b1ce-9a3c-4c6b-8347-3abe71272baf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036278 Nov 02 20:38:33.919320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 393/789] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 20:38:33.949908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:33.950402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:33.964811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.965988 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.966423 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:33.967111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:33.967559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:33.968005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:34.227307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-81b268c5-ee5c-4d3f-a590-5cc7cb087908 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-volume_attachments/c76e34d9-79f9-42a6-823a-cdccb917d490" status: 202 len: 0 microversion: 2.20 time: 0.282189 Nov 02 20:38:34.227943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 397/790] 10.222.0.26 () {60 vars in 1457 bytes} [Wed Nov 2 20:38:33 2022] DELETE /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-volume_attachments/c76e34d9-79f9-42a6-823a-cdccb917d490 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:38:34.289449 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:34.290143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:34.296299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:34.296774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:34.297203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:34.297889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:34.298334 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:34.298753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:34.341979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118986) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 20:38:34.408097 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-932c683d-2ed3-4524-a195-eb60725688ba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "POST /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/action" status: 202 len: 0 microversion: 2.20 time: 0.122566 Nov 02 20:38:34.408801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 394/791] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Nov 2 20:38:34 2022] POST /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:38:34.416869 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:34.417477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:34.425027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:34.425511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:34.426116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:34.426833 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:34.427269 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:34.427720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:34.560366 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:34.569459 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:34.570067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:34.572805 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:34.575102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:34.576530 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-939a5ea9-4985-4d19-a463-ef290a20d093 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1675 microversion: 2.20 time: 0.163479 Nov 02 20:38:34.577095 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 398/792] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:34 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:34.577629 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:34.578120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:34.578556 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:34.579250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:34.579753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:34.580172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:34.720889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:34.728788 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5e356265-a938-4ebf-b7d7-fde812ab3210 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.163354 Nov 02 20:38:34.729369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 395/793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:34 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:35.602446 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:35.602955 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:35.609786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:35.610268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:35.610698 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:35.611379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:35.611848 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:35.612263 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:35.741000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:35.749522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:35.750965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:35.752166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-211a110f-274c-4cbf-9e52-b237a0835aba tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1675 microversion: 2.20 time: 0.153710 Nov 02 20:38:35.752304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:35.752845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:35.753106 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 399/794] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:35 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:35.759109 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:35.759578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:35.760048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:35.760717 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:35.761166 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:35.761576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:35.890354 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:35.897975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d02f2f03-0867-4e4e-8c88-69d71ccdc151 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.149449 Nov 02 20:38:35.898538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 396/795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:35 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:36.777969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:36.778575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:36.784980 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:36.785451 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:36.785876 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:36.786555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:36.787053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:36.787414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:36.916396 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:36.925407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:36.926852 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:36.928048 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-58103f55-0c32-47f7-99b0-4e81fe77776c tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.154040 Nov 02 20:38:36.930466 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 400/796] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:36 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:36.930625 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:36.930625 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:36.936642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:36.937155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:36.937594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:36.938297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:36.938758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:36.939185 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:37.135767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:37.143726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4f36f67c-5b99-49e7-a5e4-36c61d58e95f tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.218526 Nov 02 20:38:37.144306 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 397/797] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:36 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:37.956827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:37.957373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:37.963918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:37.968132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:37.968833 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:37.969519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:37.971149 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:37.971821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:37.972377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:38.139234 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:38.165329 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:38.167384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:38.169156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:38.169454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:38.171571 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:38.172482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:38.173601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a67f7e4e-3bcb-4284-9367-4e90f1d9ac30 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.219011 Nov 02 20:38:38.175891 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 401/798] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:37 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:38.188323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:38.189410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:38.190097 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:38.191048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:38.191862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:38.192508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:38.381452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:38.390250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0dea1d0e-2d8e-4089-bcdb-f72f849a70cd tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.227534 Nov 02 20:38:38.390830 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 398/799] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:38 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:39.202161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:39.202763 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:39.209408 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:39.209883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:39.210312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:39.211002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:39.211449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:39.211891 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:39.350900 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:39.359270 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:39.360720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:39.361877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7fc824d2-39d6-4180-9cc6-5668292b12af tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.164279 Nov 02 20:38:39.362625 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 402/800] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:39 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:39.413391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:39.413994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:39.421111 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:39.421585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:39.422015 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:39.422706 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:39.423155 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:39.423801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:39.444698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:39.564318 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:39.572444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-07ccb916-1869-4cba-996d-791423d8af34 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.162900 Nov 02 20:38:39.573156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 399/801] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:39 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:39.970722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-0932e49e-8749-4c23-9cfd-6fa032ff68bb req-fc44cf69-e869-4c28-b4ea-a6e35ce17c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d75006-47d5-4d23-abe5-82c5074325e6", "name": "network-vif-plugged", "status": "completed", "tag": "f9d49564-9c92-410c-97b4-2a2a77c43e15"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:39.986988 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-0932e49e-8749-4c23-9cfd-6fa032ff68bb req-fc44cf69-e869-4c28-b4ea-a6e35ce17c9e service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:39.987477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-0932e49e-8749-4c23-9cfd-6fa032ff68bb req-fc44cf69-e869-4c28-b4ea-a6e35ce17c9e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:39.987923 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-0932e49e-8749-4c23-9cfd-6fa032ff68bb req-fc44cf69-e869-4c28-b4ea-a6e35ce17c9e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:39.990917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:40.006232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-0932e49e-8749-4c23-9cfd-6fa032ff68bb req-fc44cf69-e869-4c28-b4ea-a6e35ce17c9e service nova] Creating event network-vif-plugged:f9d49564-9c92-410c-97b4-2a2a77c43e15 for instance 01d75006-47d5-4d23-abe5-82c5074325e6 on hv-cinder-86236 Nov 02 20:38:40.011471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-0932e49e-8749-4c23-9cfd-6fa032ff68bb req-fc44cf69-e869-4c28-b4ea-a6e35ce17c9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044313 Nov 02 20:38:40.012257 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 403/802] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:40.387326 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:40.387970 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:40.393909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:40.394703 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:40.395212 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:40.396026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:40.396608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:40.397106 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:40.532744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:40.541986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:40.543978 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:40.545632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a032f195-5ece-4df6-83a0-7b9e69f829e7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.162482 Nov 02 20:38:40.546907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 400/803] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:40 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:40.596589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:40.597323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:40.603637 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:40.604132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:40.604630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:40.605592 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:40.605973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:40.606391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:40.748583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:40.757814 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-749e5607-8632-485c-ab35-c6b2ccfadef6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.165851 Nov 02 20:38:40.758439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 404/804] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:40 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:41.572765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:41.573508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:41.581052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:41.581728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:41.582233 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:41.583018 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:41.583567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:41.584153 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:41.719201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:41.729156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:41.730606 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:41.732597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-651f29f4-afd5-4486-a0ad-87c352d5e0b4 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.163334 Nov 02 20:38:41.733323 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 401/805] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:41 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:41.782190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:41.782802 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:41.789188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:41.789664 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:41.790090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:41.790779 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:41.791255 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:41.791708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:41.935785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:41.943707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8a17a04a-dfa6-4486-a796-bed6af5b66d5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.165943 Nov 02 20:38:41.944274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 405/806] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:41 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:42.757895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:42.758599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:42.765721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:42.766214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:42.766647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:42.767342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:42.767822 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:42.768243 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:42.902695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:42.912234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:42.913684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:42.914875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bbfde544-4cbd-4677-acdd-38db4acb3e24 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.160910 Nov 02 20:38:42.915432 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 402/807] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:42 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:42.966345 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:42.967137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:42.969849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=62 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:42.975309 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:42.975829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:42.976397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:42.977243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:42.977695 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:42.978310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:43.114432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:43.122767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-84a54773-2594-497e-8e84-2272ede6571e tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.159770 Nov 02 20:38:43.123378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 406/808] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:42 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:43.667805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:43.668290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:43.674304 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:43.674779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:43.675205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:43.675975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:43.676359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:43.676775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:43.700894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e104babe-2cdf-486e-9691-e15cc3a32f9d tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/ips" status: 200 len: 145 microversion: 2.1 time: 0.036458 Nov 02 20:38:43.707234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 403/809] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:38:43 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:43.945706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:43.946478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:43.957769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:43.958264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:43.958694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:43.959403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:43.959877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:43.960305 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:44.117093 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:44.125616 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:44.127047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:44.128464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fc186612-39cb-4dcf-ab2b-5ab8423d2474 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.190592 Nov 02 20:38:44.134217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 407/810] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:43 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:44.145275 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:44.147573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:44.152681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:44.153240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:44.154299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:44.155056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:44.155585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:44.156143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:44.296377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:44.304433 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ac1ba310-692c-45e3-a427-e83d24ffd7ad tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.163338 Nov 02 20:38:44.305133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 404/811] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:44 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:45.068576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "180505a8-dfc2-417d-9972-2c32cc2a025c"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:45.071030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:45.080297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:45.080815 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:45.081256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:45.081964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:45.082419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:45.082871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:45.157526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:45.158444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:45.162136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:45.165881 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:45.166615 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:45.167288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:45.168280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:45.168998 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:45.169483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:45.312520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:45.320855 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:45.322471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:45.323462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a2f36fdb-083a-4df8-996f-0792a2eb238a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.170704 Nov 02 20:38:45.324064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 405/812] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:45 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:45.334276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:45.334862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:45.343866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:45.344358 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:45.344795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:45.345501 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:45.345955 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:45.346376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:45.485190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:45.493145 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ffde8016-55b9-479e-901c-7ccc828b12e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.167897 Nov 02 20:38:45.493712 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 406/813] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:45 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:46.351821 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:46.353662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:46.361129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:46.361616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:46.362050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:46.362753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:46.363235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:46.363681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:46.496817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:46.505023 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:46.506463 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:46.507647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-00a11833-eb0f-4353-86ff-78ff6f9879e8 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.161161 Nov 02 20:38:46.508211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 407/814] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:46 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:46.517005 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:46.517759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:46.523809 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:46.524370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:46.524902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:46.525667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:46.526130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:46.526597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:46.659774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:46.668104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1651267d-a2cf-48bb-abc9-6255863708ce tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.155174 Nov 02 20:38:46.671564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 408/815] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:46 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:47.534365 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:47.535047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:47.541308 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:47.541779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:47.542206 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:47.542890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:47.543336 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:47.543774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:47.678937 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:47.687464 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:47.688998 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:47.690165 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a2e6355b-c7d4-4e1f-8142-5470f46f6330 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.160026 Nov 02 20:38:47.690724 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 409/816] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:47 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:47.695299 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:47.695931 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:47.703075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:47.703569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:47.704050 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:47.704752 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:47.705210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:47.705638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:47.988387 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:47.996047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5e195c4e-7428-4b1e-8f98-6b8ba915ace8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.304358 Nov 02 20:38:47.996606 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 410/817] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:47 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:48.716462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:48.717129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:48.723876 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:48.724383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:48.724819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:48.725506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:48.725958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:48.727006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:48.856347 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:48.864968 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:48.866396 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:48.867542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e14761b0-2a73-480b-872a-c0b4c188dd7a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.155241 Nov 02 20:38:48.868116 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 411/818] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:48 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:49.019295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:49.019850 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:49.025667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:49.026144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:49.026572 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:49.027253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:49.027728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:49.028147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:49.154831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:49.162445 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7afe6221-cec0-49b8-b4d9-37d9cee90acf tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.146964 Nov 02 20:38:49.163002 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 412/819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:49 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:49.894734 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:49.895352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:49.901711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:49.902185 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:49.902614 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:49.903989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:49.904504 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:49.904924 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:50.035553 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:50.043429 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:50.044889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:50.046028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-490bb6db-3553-401d-9921-f0c676f2fd56 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.155216 Nov 02 20:38:50.046576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 413/820] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:49 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:50.186438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:50.187054 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:50.192992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:50.193760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:50.194317 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:50.194846 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:50.195293 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:50.195737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:50.321415 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:50.329045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ec1d562a-23bc-400c-b26a-948d74254364 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.147051 Nov 02 20:38:50.329602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 414/821] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:50 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:51.072217 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:51.072808 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:51.079532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:51.080030 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:51.080452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:51.081126 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:51.081573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:51.081989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:51.209732 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:51.218277 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:51.219722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:51.220859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-501bd5ca-51c7-494d-a8ef-ec76e0dca6d5 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.152944 Nov 02 20:38:51.221430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 415/822] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:51 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:51.351452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:51.352090 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:51.358101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:51.358579 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:51.359010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:51.359734 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:51.360183 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:51.360602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:51.380959 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=100 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:51.493287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:51.501251 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a9a19766-5bb7-43d0-b60e-86dedbed7c39 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.153554 Nov 02 20:38:51.501813 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 416/823] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:51 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:52.245935 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:52.246626 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:52.253437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:52.253917 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:52.254345 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:52.255030 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:52.255480 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:52.255935 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:52.381678 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:52.390175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:52.391592 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:52.392773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-79432757-b35b-45a1-ab18-d8924cfd4553 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.150771 Nov 02 20:38:52.393320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 417/824] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:52 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:52.524178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:52.524777 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:52.531234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:52.531730 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:52.532160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:52.532836 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:52.533278 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:52.533692 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:52.664328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:52.671895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a3b5b0fb-7241-4335-a095-5d504a9aa95b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.151448 Nov 02 20:38:52.672451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 418/825] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:52 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:53.417332 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:53.417943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:53.425045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:53.425523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:53.425950 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:53.426677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:53.427087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:53.427505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:53.562225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:53.570553 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:53.572007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:53.573165 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-96ba5b5b-3a3c-4e2a-9edd-fc2f8a298392 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.159809 Nov 02 20:38:53.573718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 419/826] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:53 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:53.694439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:53.695048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:53.701086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:53.701560 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:53.701993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:53.702676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:53.703129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:53.703548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:53.829978 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:53.837483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a3aee69c-333b-4e16-9036-6d858e912314 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.146980 Nov 02 20:38:53.838045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 420/827] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:53 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:38:54.287169 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ca50a9cb-be2a-421d-8fe5-a15218c8ef1b tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.222669 Nov 02 20:38:54.290837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 408/828] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:38:45 2022] POST /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments => generated 194 bytes in 9224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:54.598316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:54.599036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:54.605473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:54.605951 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:54.606384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:54.607330 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:54.607818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:54.608243 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:54.739530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:54.748006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:54.749646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:54.750793 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a0442323-41a5-45ef-9007-18640ead5bed tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.156426 Nov 02 20:38:54.751343 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 421/829] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:54 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:54.861755 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:54.862460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:54.868961 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:54.869434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:54.869858 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:54.870536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:54.870981 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:54.871400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:54.999054 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:55.006559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8cdb4031-8680-4da1-ad9d-6022d922620d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1319 microversion: 2.1 time: 0.149002 Nov 02 20:38:55.007117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 409/830] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:54 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:55.776462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:55.777068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:55.784187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:55.784659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:55.785085 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:55.785765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:55.786211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:55.786627 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:55.917136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:55.925288 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:55.926721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:55.927915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-20853503-b1bb-4cb3-b844-0d22e6648bdd tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.155273 Nov 02 20:38:55.928480 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 422/831] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:55 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:56.029706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:56.030335 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:56.036763 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:56.037247 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:56.037682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:56.038375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:56.038834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:56.039256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:56.180930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:56.188837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-13ee7ac7-2c6a-4ff8-9e84-0482bbbc4815 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1507 microversion: 2.1 time: 0.163478 Nov 02 20:38:56.189406 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 410/832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:38:56 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:38:56.954996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:56.955630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:56.962423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:56.962933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:56.963390 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:56.964156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:56.964642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:56.965084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:57.102234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:57.110781 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:57.112248 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:57.113478 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-54f73b04-d4c9-443c-8cd8-d1bd8f4a66a9 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.163095 Nov 02 20:38:57.114004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 423/833] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:56 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:38:58.067743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-b0a4b3d5-14f1-4dde-9291-127b26cfc708 req-aadd74d3-5805-4962-ab21-19f3017e83b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba7c8d9-10eb-437f-a0df-a276b941e16b", "name": "network-vif-plugged", "status": "completed", "tag": "988104f9-4cc4-40c6-a3d5-9b7b5b41c840"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:38:58.079891 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-b0a4b3d5-14f1-4dde-9291-127b26cfc708 req-aadd74d3-5805-4962-ab21-19f3017e83b5 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:58.080373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-b0a4b3d5-14f1-4dde-9291-127b26cfc708 req-aadd74d3-5805-4962-ab21-19f3017e83b5 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:58.081056 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-b0a4b3d5-14f1-4dde-9291-127b26cfc708 req-aadd74d3-5805-4962-ab21-19f3017e83b5 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:58.095123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-b0a4b3d5-14f1-4dde-9291-127b26cfc708 req-aadd74d3-5805-4962-ab21-19f3017e83b5 service nova] Creating event network-vif-plugged:988104f9-4cc4-40c6-a3d5-9b7b5b41c840 for instance eba7c8d9-10eb-437f-a0df-a276b941e16b on hv-cinder-86236 Nov 02 20:38:58.100119 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-b0a4b3d5-14f1-4dde-9291-127b26cfc708 req-aadd74d3-5805-4962-ab21-19f3017e83b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036202 Nov 02 20:38:58.100792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 411/834] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:38:58.140793 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:58.142243 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:58.150510 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:58.151000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:58.151428 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:58.152160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:58.152853 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:58.153867 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:58.315495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:58.326602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:58.328875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:58.330432 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0db8e55d-cda0-4bdb-931c-76e1f0e0530d tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.194658 Nov 02 20:38:58.331122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 424/835] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:58 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:38:59.363991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:38:59.364765 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:38:59.372572 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:59.373153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:59.373510 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:59.374224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:38:59.374681 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:38:59.375105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:38:59.506719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:59.515340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:59.517269 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:38:59.518745 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-89269901-9fbd-494d-a610-36652e3db2c2 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.159624 Nov 02 20:38:59.519497 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 412/836] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:38:59 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:39:00.545577 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:00.546195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:00.553554 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:00.554038 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:00.554500 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:00.555195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:00.555675 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:00.556099 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:00.691739 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:00.701605 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:00.703087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:00.704287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7d576a5b-699c-4cce-aec5-010f73799988 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1733 microversion: 2.20 time: 0.163471 Nov 02 20:39:00.704843 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 425/837] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:39:00 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 20:39:01.730652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:01.731565 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:01.737984 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:01.738467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:01.738897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:01.739606 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:01.740161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:01.740581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:01.877472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:01.885604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:01.887047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:01.888569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-71c3eca1-b883-43e1-b1e8-45e7ed2d7e4a tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1720 microversion: 2.20 time: 0.161992 Nov 02 20:39:01.889133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 413/838] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:39:01 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:39:02.917113 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:02.919350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:02.925893 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:02.926374 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:02.926806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:02.927494 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:02.927965 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:02.928383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:02.961990 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ef5a0551-0a5d-4f42-b05f-8df7fe96c409 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048761 Nov 02 20:39:02.962988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 426/839] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:39:02 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:02.973939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:02.974484 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:02.980817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:02.981326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:02.981812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:02.982434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:02.982876 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:02.983290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:03.014182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d7c3d057-4de6-4880-902d-7037773424ae tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/180505a8-dfc2-417d-9972-2c32cc2a025c" status: 200 len: 194 microversion: 2.1 time: 0.044011 Nov 02 20:39:03.014673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 414/840] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Nov 2 20:39:02 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/180505a8-dfc2-417d-9972-2c32cc2a025c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:04.352652 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f51e630-8609-4ee9-846d-7c6c7321474e"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:39:04.355075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:04.362052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:04.362524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:04.362952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:04.363648 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:04.364100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:04.364516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:04.654239 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9a26c326-8b88-413b-8b93-56424046ca4a tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "POST /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304620 Nov 02 20:39:04.654974 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 427/841] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:39:04 2022] POST /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:13.252778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:13.255027 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:13.257669 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=17 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:13.258325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:13.265474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:13.265963 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:13.266401 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:13.267109 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:13.267555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:13.268005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:13.299142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-88f52926-0cc6-4bc8-899e-6ba51db88b65 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050296 Nov 02 20:39:13.299714 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 415/842] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:39:13 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:13.478993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:13.479573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:13.485628 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:13.486112 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:13.486548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:13.487291 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:13.487707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:13.488139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:13.517914 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1e4ada04-4295-4a56-9f6f-5d252f2502b0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/180505a8-dfc2-417d-9972-2c32cc2a025c" status: 200 len: 194 microversion: 2.1 time: 0.043956 Nov 02 20:39:13.518632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 428/843] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Nov 2 20:39:13 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/180505a8-dfc2-417d-9972-2c32cc2a025c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:13.529264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:13.529767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:13.535632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:13.536120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:13.536581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:13.537274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:13.537731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:13.538154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:13.619305 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lazy-loading 'services' on Instance uuid 09017390-da96-4b1a-881f-a512ba4d9e20 {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:39:13.689823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c632b807-ded5-492a-a29a-1e2df3916734 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/180505a8-dfc2-417d-9972-2c32cc2a025c" status: 202 len: 0 microversion: 2.1 time: 0.164507 Nov 02 20:39:13.690398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 416/844] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:39:13 2022] DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/180505a8-dfc2-417d-9972-2c32cc2a025c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:39:15.876640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:15.877193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:15.879501 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=48 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:15.884257 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:15.884744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:15.885181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:15.885878 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:15.886332 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:15.886751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:15.917000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-61cb1e5e-5802-40b0-8b1a-9691d279cf28 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/4f51e630-8609-4ee9-846d-7c6c7321474e" status: 200 len: 194 microversion: 2.1 time: 0.044263 Nov 02 20:39:15.917589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 429/845] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Nov 2 20:39:15 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/4f51e630-8609-4ee9-846d-7c6c7321474e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:15.929418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:15.930556 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:15.937052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:15.937535 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:15.937964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:15.938656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:15.939129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:15.939522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:16.019319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lazy-loading 'services' on Instance uuid 09017390-da96-4b1a-881f-a512ba4d9e20 {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:39:16.088582 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2e20992b-9a5e-4aaa-9d1a-8fcbf0f04d45 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/4f51e630-8609-4ee9-846d-7c6c7321474e" status: 202 len: 0 microversion: 2.1 time: 0.163697 Nov 02 20:39:16.089265 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 417/846] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:39:15 2022] DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments/4f51e630-8609-4ee9-846d-7c6c7321474e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:39:17.264585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:17.266736 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:17.272967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.273447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.273889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.274574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.275027 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.275452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.303854 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-14bd7be3-fa65-4c99-8b38-5c9c8d5490a6 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043834 Nov 02 20:39:17.304397 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 430/847] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:39:17 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:39:17.419296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:17.421634 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:17.427728 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.428212 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.428647 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.429339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.429790 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.430212 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.458848 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-944040fa-9293-41d7-b2a8-8686d9bcbdb0 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044341 Nov 02 20:39:17.459392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 418/848] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:39:17 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:39:17.523725 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:17.524215 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:17.531081 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.531557 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.532016 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.532701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.533149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.533563 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.558357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:39:17.561259 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:17.635960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8953bb66-cba4-41c2-aef6-1bdc0d660791 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 204 len: 0 microversion: 2.1 time: 0.115724 Nov 02 20:39:17.641042 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 431/849] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:39:17 2022] DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:39:17.645518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:17.646144 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:17.652418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.653106 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.653569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.654299 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:17.654774 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:17.655176 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:17.792542 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:17.800349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ebad73c8-212b-4ec2-b9c8-fe237de6d4a9 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1673 microversion: 2.1 time: 0.158726 Nov 02 20:39:17.800915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 419/850] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:17 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:39:18.800314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48819978-eab4-4a9e-864b-b92042fccb18", "device": "/dev/sdb"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:39:18.803218 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:18.809519 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:18.810784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:18.811217 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:18.811930 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:18.812384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:18.812803 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:18.824292 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:18.824829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:18.831421 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:18.831931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:18.832808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:18.833042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:18.833490 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:18.833908 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:18.961232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:18.968962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ebc9af2c-8da3-42e7-981e-d5e18e5187cb tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1673 microversion: 2.1 time: 0.148533 Nov 02 20:39:18.969529 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 420/851] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:18 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:39:19.525075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6729139b-2486-4f3a-86f2-10011138dac0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "POST /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728903 Nov 02 20:39:19.525845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 432/852] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:39:18 2022] POST /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:19.992682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:19.993290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:20.000434 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:20.001166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:20.001832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:20.002766 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:20.003455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:20.004122 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:20.135479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:20.143859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-14bc7b4a-781b-4f5f-9561-75c7fcd82c5c tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1673 microversion: 2.1 time: 0.155164 Nov 02 20:39:20.144429 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 421/853] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:19 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:39:21.167473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:21.168203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:21.174734 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:21.175216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:21.175677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:21.176380 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:21.176825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:21.177244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:21.478485 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1a7490162d4aeaa1f96da542fea26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c6156b36b1446b9c9a2320fe1f97fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:21.487374 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2041ea9d-1924-48b7-8a98-c918564fa452 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 200 len: 1673 microversion: 2.1 time: 0.324620 Nov 02 20:39:21.487970 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 433/854] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:21 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 1673 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:39:21.698812 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-c99c992b-bd65-4c0c-8a5b-d0220492447a req-53dcacce-5498-4805-979f-8652976c8146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09017390-da96-4b1a-881f-a512ba4d9e20", "name": "network-vif-deleted", "tag": "96066662-2ec4-470e-9e1b-7f01306d74dd"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:39:21.709052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c99c992b-bd65-4c0c-8a5b-d0220492447a req-53dcacce-5498-4805-979f-8652976c8146 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:21.709693 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c99c992b-bd65-4c0c-8a5b-d0220492447a req-53dcacce-5498-4805-979f-8652976c8146 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:21.710186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c99c992b-bd65-4c0c-8a5b-d0220492447a req-53dcacce-5498-4805-979f-8652976c8146 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:21.723103 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-c99c992b-bd65-4c0c-8a5b-d0220492447a req-53dcacce-5498-4805-979f-8652976c8146 service nova] Creating event network-vif-deleted:96066662-2ec4-470e-9e1b-7f01306d74dd for instance 09017390-da96-4b1a-881f-a512ba4d9e20 on hv-cinder-86236 Nov 02 20:39:21.734565 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-c99c992b-bd65-4c0c-8a5b-d0220492447a req-53dcacce-5498-4805-979f-8652976c8146 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036540 Nov 02 20:39:21.739021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 422/855] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:22.510471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:22.511104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:22.518525 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:22.519007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:22.519439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:22.520176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:22.520625 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:22.521041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:22.535510 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] HTTP exception thrown: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Request method failure captured: Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 HTTP/1.1 Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNZOW8dHijMrFb9vJuL7qTPmbei_EdCxIwqNF8kX9aZ3BOsJfnwBF6cZrYY_9WdnRPnK8TIfbSBMHnTqS97WcaZRgI0lL8PKyJIbYT50bDmYsxxl4qBlvQ5cD2bXN4eVoGC35lJSG2uZx8Ac-AkKV6qEhBx_Z7AALTuJdPdrnIsYEA Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:39:22.537250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}] Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: aa1a7490162d4aeaa1f96da542fea26f Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:22.538885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '09017390-da96-4b1a-881f-a512ba4d9e20'} Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:39:22.540102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:22.541633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:22.543021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Returning 404 to user: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:39:22.543021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6b6bd324-a37e-4cdb-b7fc-59c0cf87b771 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 404 len: 111 microversion: 2.1 time: 0.032128 Nov 02 20:39:22.543021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 434/856] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:22 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:39:22.548782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5e8ce8f8-0812-46ab-b906-b1a6a43475a4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '.version_select at 0x7f2e222a74c0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:22.567863 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5e8ce8f8-0812-46ab-b906-b1a6a43475a4 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718274253" status: 202 len: 0 microversion: 2.1 time: 0.023885 Nov 02 20:39:22.568432 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 423/857] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 20:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718274253 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:39:25.429027 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:25.429536 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:25.437149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:25.437626 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:25.438058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:25.438744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:25.439193 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:25.439636 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:25.453709 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] HTTP exception thrown: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Request method failure captured: Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 HTTP/1.1 Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNZOW8dHijMrFb9vJuL7qTPmbei_EdCxIwqNF8kX9aZ3BOsJfnwBF6cZrYY_9WdnRPnK8TIfbSBMHnTqS97WcaZRgI0lL8PKyJIbYT50bDmYsxxl4qBlvQ5cD2bXN4eVoGC35lJSG2uZx8Ac-AkKV6qEhBx_Z7AALTuJdPdrnIsYEA Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:39:25.455279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}] Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: aa1a7490162d4aeaa1f96da542fea26f Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.456880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '09017390-da96-4b1a-881f-a512ba4d9e20'} Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:39:25.457691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.459000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.460462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Returning 404 to user: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:39:25.460462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3e942c69-3dcd-4e53-809d-e3c2caaf1c08 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 404 len: 111 microversion: 2.1 time: 0.031513 Nov 02 20:39:25.460462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 435/858] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:39:25 2022] DELETE /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:39:25.467010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:25.467762 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 09017390-da96-4b1a-881f-a512ba4d9e20] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:25.475930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:25.476407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:25.476834 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:25.477510 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:25.477957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:25.478374 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:25.491130 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] HTTP exception thrown: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Request method failure captured: Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 HTTP/1.1 Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNZOW8dHijMrFb9vJuL7qTPmbei_EdCxIwqNF8kX9aZ3BOsJfnwBF6cZrYY_9WdnRPnK8TIfbSBMHnTqS97WcaZRgI0lL8PKyJIbYT50bDmYsxxl4qBlvQ5cD2bXN4eVoGC35lJSG2uZx8Ac-AkKV6qEhBx_Z7AALTuJdPdrnIsYEA Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:39:25.492752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}] Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: aa1a7490162d4aeaa1f96da542fea26f Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.494277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '09017390-da96-4b1a-881f-a512ba4d9e20'} Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:39:25.495146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. Nov 02 20:39:25.496593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:25.498723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Returning 404 to user: Instance 09017390-da96-4b1a-881f-a512ba4d9e20 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:39:25.498723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-720bd91b-40a6-4940-810c-ba7cae6dd281 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20" status: 404 len: 111 microversion: 2.1 time: 0.031758 Nov 02 20:39:25.498723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 424/859] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:25 2022] GET /compute/v2.1/servers/09017390-da96-4b1a-881f-a512ba4d9e20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:39:26.633546 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:26.634041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:26.640906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:26.641397 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:26.641830 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:26.642526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:26.642984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:26.643408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:26.657484 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] HTTP exception thrown: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Request method failure captured: Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: DELETE /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b HTTP/1.1 Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNZOW8dHijMrFb9vJuL7qTPmbei_EdCxIwqNF8kX9aZ3BOsJfnwBF6cZrYY_9WdnRPnK8TIfbSBMHnTqS97WcaZRgI0lL8PKyJIbYT50bDmYsxxl4qBlvQ5cD2bXN4eVoGC35lJSG2uZx8Ac-AkKV6qEhBx_Z7AALTuJdPdrnIsYEA Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:39:26.659034 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}] Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: aa1a7490162d4aeaa1f96da542fea26f Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.660655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '738d7da5-411f-449b-82cd-ad465b7d559b'} Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:39:26.663947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.665137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.666337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Returning 404 to user: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:39:26.666337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-66e2e5cf-4c82-4b16-959d-975e0dd72c56 tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 404 len: 111 microversion: 2.1 time: 0.030758 Nov 02 20:39:26.666337 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 436/860] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:39:26 2022] DELETE /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:39:26.670402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:26.671017 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] [instance: 738d7da5-411f-449b-82cd-ad465b7d559b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:26.677873 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:26.678376 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:26.678803 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:26.679754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:26.680208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:26.680619 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:26.694661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] HTTP exception thrown: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Request method failure captured: Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b HTTP/1.1 Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNZOW8dHijMrFb9vJuL7qTPmbei_EdCxIwqNF8kX9aZ3BOsJfnwBF6cZrYY_9WdnRPnK8TIfbSBMHnTqS97WcaZRgI0lL8PKyJIbYT50bDmYsxxl4qBlvQ5cD2bXN4eVoGC35lJSG2uZx8Ac-AkKV6qEhBx_Z7AALTuJdPdrnIsYEA Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:39:26.696313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74c6156b36b1446b9c9a2320fe1f97fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74c6156b36b1446b9c9a2320fe1f97fd"}]}] Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 74c6156b36b1446b9c9a2320fe1f97fd Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1061729554 Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: aa1a7490162d4aeaa1f96da542fea26f Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeTestJSON-1061729554-project Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.697635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '738d7da5-411f-449b-82cd-ad465b7d559b'} Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:39:26.698342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. Nov 02 20:39:26.699892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:39:26.700974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] Returning 404 to user: Instance 738d7da5-411f-449b-82cd-ad465b7d559b could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:39:26.700974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-37fbd19c-64b5-4f5c-b737-1af0a19063ee tempest-AttachVolumeTestJSON-1061729554 tempest-AttachVolumeTestJSON-1061729554-project] 10.222.0.26 "GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b" status: 404 len: 111 microversion: 2.1 time: 0.031716 Nov 02 20:39:26.700974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 425/861] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:26 2022] GET /compute/v2.1/servers/738d7da5-411f-449b-82cd-ad465b7d559b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:39:49.442569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:49.443064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:49.446147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:49.446795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:49.454453 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:49.455875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:49.456319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:49.457012 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:49.457466 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:49.457886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:49.540401 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lazy-loading 'services' on Instance uuid 01d75006-47d5-4d23-abe5-82c5074325e6 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:39:49.610727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6f6693d0-f136-47b8-b3e2-acf11e0b9718 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "DELETE /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6/os-volume_attachments/48819978-eab4-4a9e-864b-b92042fccb18" status: 202 len: 0 microversion: 2.1 time: 0.172097 Nov 02 20:39:49.611514 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 437/862] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:39:49 2022] DELETE /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6/os-volume_attachments/48819978-eab4-4a9e-864b-b92042fccb18 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:39:50.739147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:50.739760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:50.742222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:50.742856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:50.748585 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:50.749061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:50.749487 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:50.750171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:50.750616 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:50.751030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:50.776618 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:39:50.849888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2ca2ffb9-b836-43c7-a649-f988bd58d2a3 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "DELETE /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 204 len: 0 microversion: 2.1 time: 0.115146 Nov 02 20:39:50.850464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 426/863] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:39:50 2022] DELETE /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:39:50.860443 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:50.861754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:50.867906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:50.868384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:50.868841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:50.869528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:50.869979 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:50.870394 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:50.996706 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:51.004530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-224bc1f7-f4a0-48b3-90ae-8eb0336ad15b tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1513 microversion: 2.1 time: 0.149017 Nov 02 20:39:51.005093 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 438/864] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:50 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:39:52.028533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:52.029233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:52.036014 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:52.036488 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:52.036917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:52.037598 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:52.038044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:52.038460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:52.164992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:52.172637 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-30dbe325-43ff-4476-82fc-8d100fe12f89 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1513 microversion: 2.1 time: 0.148350 Nov 02 20:39:52.173224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 427/865] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:52 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:39:53.196702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:53.197306 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:53.203542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:53.204073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:53.204515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:53.205378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:53.205827 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:53.206242 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:53.390779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:39:53.398781 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8d40e3a5-3394-45fa-929f-69168e70a64d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 200 len: 1513 microversion: 2.1 time: 0.206293 Nov 02 20:39:53.399364 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 439/866] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:53 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:39:53.474486 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-fc8d997b-242a-4d80-8ec3-9e8e423638db req-1a70571c-665a-4670-b3b9-bce6c50aa392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d75006-47d5-4d23-abe5-82c5074325e6", "name": "network-vif-deleted", "tag": "f9d49564-9c92-410c-97b4-2a2a77c43e15"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:39:53.484628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-fc8d997b-242a-4d80-8ec3-9e8e423638db req-1a70571c-665a-4670-b3b9-bce6c50aa392 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:53.485105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-fc8d997b-242a-4d80-8ec3-9e8e423638db req-1a70571c-665a-4670-b3b9-bce6c50aa392 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:53.485531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-fc8d997b-242a-4d80-8ec3-9e8e423638db req-1a70571c-665a-4670-b3b9-bce6c50aa392 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:53.497217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-fc8d997b-242a-4d80-8ec3-9e8e423638db req-1a70571c-665a-4670-b3b9-bce6c50aa392 service nova] Creating event network-vif-deleted:f9d49564-9c92-410c-97b4-2a2a77c43e15 for instance 01d75006-47d5-4d23-abe5-82c5074325e6 on hv-cinder-86236 Nov 02 20:39:53.503395 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-fc8d997b-242a-4d80-8ec3-9e8e423638db req-1a70571c-665a-4670-b3b9-bce6c50aa392 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033284 Nov 02 20:39:53.504301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 428/867] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:39:54.424144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:39:54.424753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 01d75006-47d5-4d23-abe5-82c5074325e6] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:39:54.430941 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:54.431459 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:54.431864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:54.432739 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:39:54.433198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:39:54.433617 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:39:54.446791 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] HTTP exception thrown: Instance 01d75006-47d5-4d23-abe5-82c5074325e6 could not be found. Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Request method failure captured: Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 HTTP/1.1 Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtVBf2TMWtGcXcnwPmrkVCXK8U7udZ7jY32h4kP5_3foSMcZLs2H7V4ns8LDIKCSiBDhCom-De4pPlodU1YC9mDR41t1PhKUAEqq1NVlr4oDMeBeIO-grmV7SrFDNtEGoVZBX19Q-_3Y7yv6nb1KXrAvLToGMWjcB3yQjzZ927mkAmI Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 0986044b31c543f6abc0adecffefb929 Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1362961242 Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:39:54.448438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0986044b31c543f6abc0adecffefb929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0986044b31c543f6abc0adecffefb929"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0986044b31c543f6abc0adecffefb929"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0986044b31c543f6abc0adecffefb929"}]}] Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-VolumesSnapshotTestJSON-1362961242 Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 0986044b31c543f6abc0adecffefb929 Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1362961242 Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-VolumesSnapshotTestJSON-1362961242-project Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 7c5ace8b734d4304bf68ccf9436a702f Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-VolumesSnapshotTestJSON-1362961242-project Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 01d75006-47d5-4d23-abe5-82c5074325e6 could not be found. Nov 02 20:39:54.450067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '01d75006-47d5-4d23-abe5-82c5074325e6'} Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d75006-47d5-4d23-abe5-82c5074325e6 could not be found. Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:39:54.451004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d75006-47d5-4d23-abe5-82c5074325e6 could not be found. Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d75006-47d5-4d23-abe5-82c5074325e6 could not be found. Nov 02 20:39:54.452530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:39:54.453991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Returning 404 to user: Instance 01d75006-47d5-4d23-abe5-82c5074325e6 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:39:54.453991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4dc9fab5-a748-4dd5-95be-b09fe870b183 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6" status: 404 len: 111 microversion: 2.1 time: 0.030193 Nov 02 20:39:54.453991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 440/868] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:39:54 2022] GET /compute/v2.1/servers/01d75006-47d5-4d23-abe5-82c5074325e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:05.382139 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:05.383278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:05.387330 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-718097420", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452", "networks": [{"uuid": "8fff70e5-c2da-457b-a6d0-ebb221f9f423"}]}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:40:05.441518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] validate_networks() for [('8fff70e5-c2da-457b-a6d0-ebb221f9f423', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:40:05.782517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:40:05.782940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:40:05.783945 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:40:05.784390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:40:05.784807 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:40:05.793503 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:05.793995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:05.794429 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:05.795159 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:05.795643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:05.796085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:05.813028 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Getting quotas for project 0986044b31c543f6abc0adecffefb929. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:40:05.817059 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Getting quotas for user 7c5ace8b734d4304bf68ccf9436a702f and project 0986044b31c543f6abc0adecffefb929. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:40:05.828136 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:40:05.830637 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:40:05.878514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-761d8f30-29a8-4dd7-8285-dddb2c8a3ca5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497866 Nov 02 20:40:05.884959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 429/869] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:40:05.890268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e7e4846b-1b99-45cb-b70f-9cd247c664ea tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:05.890960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e7e4846b-1b99-45cb-b70f-9cd247c664ea tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:05.895007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=8 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:05.895870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:05.951387 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e7e4846b-1b99-45cb-b70f-9cd247c664ea tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:05.958775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e7e4846b-1b99-45cb-b70f-9cd247c664ea tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1218 microversion: 2.1 time: 0.072378 Nov 02 20:40:05.959461 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 441/870] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:05 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:06.982498 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:06.983166 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:06.990210 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:06.990686 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:06.991142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:06.991859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:06.992308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:06.992758 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:07.055964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:07.063443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c2ad252a-5cf7-48e5-b531-1fc8786b5c73 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1222 microversion: 2.1 time: 0.085284 Nov 02 20:40:07.064028 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 430/871] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:06 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:08.086533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:08.087144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:08.094244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:08.094717 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:08.095143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:08.096335 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:08.096964 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:08.097386 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:08.160428 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:08.168395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-32eb6e5e-d701-4700-abec-bdd99c51fd49 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1222 microversion: 2.1 time: 0.085732 Nov 02 20:40:08.168961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 442/872] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:08 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:09.190308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:09.190853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:09.198265 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:09.198752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:09.199188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:09.199912 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:09.200369 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:09.200798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:09.263912 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:09.271783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c9e20034-0122-4668-bf93-047124a93d72 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1270 microversion: 2.1 time: 0.085421 Nov 02 20:40:09.279667 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 431/873] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:09 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:10.295496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:10.296070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:10.302415 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:10.302896 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:10.303321 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:10.304039 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:10.304488 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:10.304907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:10.431117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:10.438684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-effd36e5-d314-46e0-a8a6-b1e447f949c0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.147238 Nov 02 20:40:10.439247 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 443/874] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:10 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:11.462823 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:11.463459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:11.469856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:11.470337 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:11.470767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:11.471454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:11.471941 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:11.472969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:11.598147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:11.605879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9aacfed6-00bb-4a6d-a2c4-b0b54cf1beec tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.146908 Nov 02 20:40:11.606445 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 432/875] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:11 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:12.611554 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-ec402778-b63d-4398-92de-bd9a5cfc3f24 req-dd89697d-1d5d-406a-adfc-34a94e6e1300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8844201c-5219-44bd-915a-22fe1ddf6726", "tag": "0f65f3f1-8c11-4161-aef3-b30c3535b81d"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:40:12.621674 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ec402778-b63d-4398-92de-bd9a5cfc3f24 req-dd89697d-1d5d-406a-adfc-34a94e6e1300 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:12.622139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ec402778-b63d-4398-92de-bd9a5cfc3f24 req-dd89697d-1d5d-406a-adfc-34a94e6e1300 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:12.623860 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-ec402778-b63d-4398-92de-bd9a5cfc3f24 req-dd89697d-1d5d-406a-adfc-34a94e6e1300 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:12.629229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:12.629898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:12.634241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-ec402778-b63d-4398-92de-bd9a5cfc3f24 req-dd89697d-1d5d-406a-adfc-34a94e6e1300 service nova] Creating event network-changed:0f65f3f1-8c11-4161-aef3-b30c3535b81d for instance 8844201c-5219-44bd-915a-22fe1ddf6726 on hv-cinder-86236 Nov 02 20:40:12.636853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:12.637444 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:12.637921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:12.638858 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:12.639273 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-ec402778-b63d-4398-92de-bd9a5cfc3f24 req-dd89697d-1d5d-406a-adfc-34a94e6e1300 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031387 Nov 02 20:40:12.639404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:12.639740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:12.640055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 444/876] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:40:12.946644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:12.954323 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3af287a8-1a40-416f-ad82-c9827f90bbb8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.329238 Nov 02 20:40:12.954888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 433/877] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:12 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:13.978238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:13.978932 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:13.984940 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:13.985408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:13.985841 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:13.986515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:13.986963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:13.987374 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:14.181701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:14.189532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-88258ebd-70a8-4598-9dad-f9179c3f7ad5 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.215962 Nov 02 20:40:14.190087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 445/878] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:13 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:15.212452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:15.213069 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:15.219473 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:15.219989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:15.220426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:15.221115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:15.221572 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:15.221998 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:15.347840 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:15.355580 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f17a070c-9fa7-4332-a8a9-53d7f8c0f118 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.147185 Nov 02 20:40:15.356168 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 434/879] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:15 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:15.853760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:15.854255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:15.860536 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:15.861057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:15.861486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:15.862168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:15.862616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:15.863030 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:15.886085 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f4778b19-b678-4b96-9c71-3b4b715414fb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.036153 Nov 02 20:40:15.886659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 446/880] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 20:40:15 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:16.380226 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:16.380968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:16.382792 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:16.383485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=6 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:16.389696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:16.390176 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:16.390608 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:16.391295 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:16.391778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:16.392198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:16.523350 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:16.531256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8c383e93-850a-416a-86b6-f182776e59cb tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.155012 Nov 02 20:40:16.531863 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 435/881] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:16 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:17.239239 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1eb178c-b473-4260-b5ea-2618b77ec9f4"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:40:17.242253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:17.244255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:17.249642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:17.250118 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:17.250551 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:17.251239 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:17.251717 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:17.252137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:17.512685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d5091f52-c6f2-4cd7-a704-aeefcdc8ed0f tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "POST /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277231 Nov 02 20:40:17.513214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 447/882] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:40:17 2022] POST /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:17.554648 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:17.555281 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:17.562684 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:17.563197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:17.563641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:17.564478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:17.564958 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:17.565402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:17.700639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:17.708694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-07e5094b-5c0f-4721-8fd5-46d002820b64 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.157804 Nov 02 20:40:17.709256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 436/883] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:17 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:18.732531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:18.733228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:18.740124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:18.740805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:18.741221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:18.741907 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:18.742352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:18.742765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:18.872040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:18.879535 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-71227c44-7562-492f-82d6-a81102a3aee1 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.151847 Nov 02 20:40:18.880707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 448/884] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:18 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:19.464537 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-45b6fec2-5a91-49ae-8e61-5f028dd030f8 req-025e567b-0315-4f47-bd52-a5d41b73ed2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8844201c-5219-44bd-915a-22fe1ddf6726", "name": "network-vif-plugged", "status": "completed", "tag": "0f65f3f1-8c11-4161-aef3-b30c3535b81d"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:40:19.475326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-45b6fec2-5a91-49ae-8e61-5f028dd030f8 req-025e567b-0315-4f47-bd52-a5d41b73ed2b service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:19.475829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-45b6fec2-5a91-49ae-8e61-5f028dd030f8 req-025e567b-0315-4f47-bd52-a5d41b73ed2b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:19.478921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-45b6fec2-5a91-49ae-8e61-5f028dd030f8 req-025e567b-0315-4f47-bd52-a5d41b73ed2b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:19.491146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-45b6fec2-5a91-49ae-8e61-5f028dd030f8 req-025e567b-0315-4f47-bd52-a5d41b73ed2b service nova] Creating event network-vif-plugged:0f65f3f1-8c11-4161-aef3-b30c3535b81d for instance 8844201c-5219-44bd-915a-22fe1ddf6726 on hv-cinder-86236 Nov 02 20:40:19.496167 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-45b6fec2-5a91-49ae-8e61-5f028dd030f8 req-025e567b-0315-4f47-bd52-a5d41b73ed2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035302 Nov 02 20:40:19.496758 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 437/885] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:19.904358 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:19.905011 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:19.913249 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:19.913721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:19.914146 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:19.914832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:19.915280 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:19.915718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:20.112659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:20.122263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1c519d46-52ac-45a9-988f-2a5017aecb68 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.222757 Nov 02 20:40:20.123044 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 449/886] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:19 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:21.147073 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:21.147787 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:21.153884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:21.154356 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:21.154781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:21.155458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:21.155933 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:21.156348 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:21.283367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:21.291129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-58d161d9-d6b7-4d50-93b0-90cc1c0a4850 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.149254 Nov 02 20:40:21.291706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 438/887] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:21 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:22.313706 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:22.314314 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:22.321599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:22.322071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:22.322500 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:22.323178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:22.323639 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:22.324061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:22.453480 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:22.461366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-dc1ba6dd-2dab-4110-9f6e-494d12364990 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.151577 Nov 02 20:40:22.461921 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 450/888] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:22 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:23.484412 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:23.485026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:23.492192 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:23.492712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:23.493146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:23.493836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:23.494296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:23.494720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:23.624567 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:23.632897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-456107a6-11ad-4431-84de-032783b3db0c tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.152295 Nov 02 20:40:23.633402 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 439/889] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:23 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:24.655319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:24.655960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:24.662800 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:24.663268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:24.663726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:24.664408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:24.664853 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:24.665267 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:24.804690 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:24.812266 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e1c1049e-44f9-4aef-b271-37cc5dd0ac14 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.160901 Nov 02 20:40:24.812817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 451/890] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:24 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:25.835030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:25.835657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:25.842264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:25.842734 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:25.843157 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:25.843859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:25.844302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:25.844716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:25.971974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:25.979704 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b052602e-212d-4c16-8432-8677e898594d tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1318 microversion: 2.1 time: 0.148455 Nov 02 20:40:25.980285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 440/891] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:25 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:27.003244 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:27.003871 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:27.010847 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.011328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.011807 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.012509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.012959 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.013378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.152856 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:27.160685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-13388382-0773-479e-b070-120446841f11 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1506 microversion: 2.1 time: 0.161978 Nov 02 20:40:27.161564 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 452/892] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:26 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:27.185771 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "100cbfdd-0e11-47e2-a78b-19eff7a543ff", "device": "/dev/sdb"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:40:27.188694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:27.196198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.196684 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.197120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.197821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.198277 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.198699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.310129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:27.310615 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:27.318440 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.318613 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.319204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.319928 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.320379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.320794 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.403429 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lazy-loading 'services' on Instance uuid 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:40:27.475254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-afa4e720-0e39-4b15-93f2-372d4510e874 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "POST /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292179 Nov 02 20:40:27.475889 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 441/893] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:40:27 2022] POST /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:27.476405 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0a6b4df1-9477-43f4-bbd1-39e49a8d2d11 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments/c1eb178c-b473-4260-b5ea-2618b77ec9f4" status: 202 len: 0 microversion: 2.1 time: 0.170067 Nov 02 20:40:27.477130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 453/894] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:40:27 2022] DELETE /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments/c1eb178c-b473-4260-b5ea-2618b77ec9f4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 20:40:27.493338 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:27.496167 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:27.503564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.504072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.504506 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.505830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:27.506292 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:27.506772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:27.537386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-da9bc919-29d0-4f7c-9e7f-b82b2db03f00 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052213 Nov 02 20:40:27.538102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 442/895] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:27 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:40:28.551250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:28.554526 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:28.561258 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:28.561735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:28.562350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:28.563047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:28.563506 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:28.563945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:28.595518 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4922be75-e8ad-49a8-aba0-f169298268b2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049172 Nov 02 20:40:28.596356 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 454/896] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:28 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:40:29.609349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:29.611808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:29.620473 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:29.620990 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:29.621650 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:29.622100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:29.622547 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:29.622964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:29.653965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dba03275-567e-43a5-908a-662c917f7927 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048585 Nov 02 20:40:29.654542 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 443/897] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:29 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:30.667267 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:30.669681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:30.676396 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:30.677595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:30.678130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:30.678760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:30.679206 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:30.679638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:30.712060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8e82ff37-821e-457b-bde9-2745e98cb7a3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048750 Nov 02 20:40:30.716810 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 455/898] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:30 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:40:31.724783 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:31.726871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:31.733766 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:31.733891 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:31.734319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:31.735010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:31.735464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:31.735914 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:31.766176 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-98b6d96c-47b1-4e1c-8fb1-5539b43af8f1 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Nov 02 20:40:31.766923 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 444/899] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:31 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:32.778542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:32.780735 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:32.787587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:32.788089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:32.788524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:32.789198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:32.789645 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:32.790059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:32.819854 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1acc7a11-3f7e-4c86-bdb1-63b830df58e3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Nov 02 20:40:32.820414 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 456/900] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:32 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:33.832326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:33.835091 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:33.841463 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:33.841937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:33.842364 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:33.843042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:33.843490 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:33.843940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:33.860121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:33.875589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-35a33505-c3dc-4b79-afea-16e58797cdcb tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047161 Nov 02 20:40:33.876185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 445/901] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:33 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:34.888603 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:34.890819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:34.897134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:34.897629 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:34.898059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:34.898770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:34.899221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:34.899660 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:34.916927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:34.931901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1676de26-0cb5-4457-b9cc-11ded522d48b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047095 Nov 02 20:40:34.933091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 457/902] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:34 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:35.944658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:35.946795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:35.949357 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:35.954502 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:35.954982 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:35.955415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:35.956127 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:35.956583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:35.957002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:35.987994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1a462415-f3e2-4189-8dd6-739fa872e5b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047675 Nov 02 20:40:35.988922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 446/903] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:35 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:37.001224 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:37.003348 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:37.006444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=37 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:37.012048 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:37.012523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:37.012949 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:37.013633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:37.014078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:37.014493 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:37.043019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a58b1d72-8e8a-450d-bf14-1d8c9661292d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Nov 02 20:40:37.043573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 458/904] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:36 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:38.054767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:38.056893 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:38.063351 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:38.063872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:38.064301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:38.065032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:38.065485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:38.065909 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:38.097574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7958cfb8-a23c-459d-b1a7-dbea217ccdf6 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Nov 02 20:40:38.098129 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 447/905] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:38 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:39.112379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:39.115593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:39.122496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:39.122980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:39.123407 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:39.124127 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:39.124576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:39.125019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:39.154619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-39e85bea-6004-4afa-98f6-24865e9ef929 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046166 Nov 02 20:40:39.157043 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 459/906] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:40:39 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:40:39.225748 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:39.226231 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:39.232485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:39.232968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:39.233403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:39.234092 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:39.234545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:39.234964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:39.263351 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:40:39.341855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-84a29ef5-fd4b-46bb-abdd-690e404263b3 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 204 len: 0 microversion: 2.1 time: 0.120000 Nov 02 20:40:39.342472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 448/907] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:40:39 2022] DELETE /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 20:40:39.352883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:39.353630 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:39.359523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:39.360064 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:39.360493 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:39.361176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:39.361622 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:39.362069 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:39.509652 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:39.517454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-91232945-1876-4237-b9f6-1b30aef61464 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1681 microversion: 2.1 time: 0.169982 Nov 02 20:40:39.518012 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 460/908] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:39 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:40.541937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:40.542632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:40.549053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:40.549533 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:40.549964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:40.550651 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:40.551102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:40.551523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:40.683199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:40.690906 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-76102424-ad82-4f57-b902-565e242f3f19 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1681 microversion: 2.1 time: 0.153167 Nov 02 20:40:40.691472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 449/909] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:40 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:41.715188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:41.715774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:41.722255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:41.722742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:41.723179 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:41.724521 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:41.724985 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:41.725413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:41.854359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:41.861922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c994c6b2-07a6-4f6f-a09f-9505d5769ab7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1681 microversion: 2.1 time: 0.150677 Nov 02 20:40:41.862486 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 461/910] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:41 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:42.885354 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:42.885959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:42.892330 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:42.892805 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:42.893230 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:42.893916 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:42.894367 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:42.894786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:43.021397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:43.029045 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5ad85dac-2102-4d44-bd91-79a0d4cf3107 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1681 microversion: 2.1 time: 0.147592 Nov 02 20:40:43.029612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 450/911] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:42 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:40:44.053624 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:44.054133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:44.060561 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:44.061036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:44.061462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:44.062144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:44.062593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:44.063024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:44.191538 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:44.199500 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6de7d84a-1741-42cf-873d-3c5803f273d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1681 microversion: 2.1 time: 0.150509 Nov 02 20:40:44.200087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 462/912] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:44 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:45.222273 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:45.222878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:45.229489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:45.229992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:45.230421 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:45.231095 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:45.231543 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:45.231986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:45.360786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:45.368868 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-81925cc3-b6e3-4184-8025-ff406536dcb2 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1681 microversion: 2.1 time: 0.150470 Nov 02 20:40:45.369431 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 451/913] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:45 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:46.392043 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:46.392681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:46.400000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:46.400901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:46.401638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:46.402505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:46.403127 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:46.403738 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:46.538475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:46.546176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6aeb3272-1abf-4ef9-af0f-c4236c5a1bf7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1614 microversion: 2.1 time: 0.158336 Nov 02 20:40:46.546736 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 463/914] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:46 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1614 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:46.701094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-7b2ad1c8-c1ca-4e55-b752-c52d9f1bb3f3 req-96868204-9710-41cd-8ea4-549373cd2f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3074dbb7-dbe0-41cf-ad30-4671f3099eb5", "name": "network-vif-deleted", "tag": "16b71ca4-6bda-4703-8d12-3bf13b153abe"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:40:46.711457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7b2ad1c8-c1ca-4e55-b752-c52d9f1bb3f3 req-96868204-9710-41cd-8ea4-549373cd2f39 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:46.711956 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7b2ad1c8-c1ca-4e55-b752-c52d9f1bb3f3 req-96868204-9710-41cd-8ea4-549373cd2f39 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:46.712381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7b2ad1c8-c1ca-4e55-b752-c52d9f1bb3f3 req-96868204-9710-41cd-8ea4-549373cd2f39 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:46.740606 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-7b2ad1c8-c1ca-4e55-b752-c52d9f1bb3f3 req-96868204-9710-41cd-8ea4-549373cd2f39 service nova] Creating event network-vif-deleted:16b71ca4-6bda-4703-8d12-3bf13b153abe for instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 on hv-cinder-86236 Nov 02 20:40:46.758485 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-7b2ad1c8-c1ca-4e55-b752-c52d9f1bb3f3 req-96868204-9710-41cd-8ea4-549373cd2f39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060991 Nov 02 20:40:46.759759 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 452/915] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:47.570844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:47.572739 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:47.579373 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:47.579982 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:47.580485 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:47.581261 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:47.581842 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:47.582380 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:47.656286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:47.664890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6fb1563e-3c45-4e7b-8c60-f110d0bfb039 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1614 microversion: 2.1 time: 0.098176 Nov 02 20:40:47.667658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 464/916] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:47 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:48.689685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:48.690881 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:48.699390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:48.699990 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:48.700422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:48.701143 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:48.701596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:48.702204 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:48.774274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:48.782390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-97a500cb-a73e-4030-b2f1-3fed4043bb58 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1327 microversion: 2.1 time: 0.097580 Nov 02 20:40:48.783192 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 453/917] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:48 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:49.806324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:49.806848 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:49.813537 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:49.814019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:49.814444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:49.815132 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:49.815578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:49.816018 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:49.878363 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:49.887135 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7f39ad69-fcb1-4564-9ec8-c2d87973d1d7 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1327 microversion: 2.1 time: 0.084656 Nov 02 20:40:49.899312 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 465/918] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:49 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1327 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:50.911356 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:50.912197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:50.919043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:50.919597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:50.920142 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:50.920955 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:50.921513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:50.922105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:50.967326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:50.968182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:50.968730 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:50.969244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lazy-loading 'fault' on Instance uuid 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:40:51.014239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89876cb8e3a040eca4ec8d15a2df0cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7a92134ad4771991bf954e6278efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:51.022991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-aca3156b-76ff-43d4-983f-7e8274100ac8 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 200 len: 1332 microversion: 2.1 time: 0.116753 Nov 02 20:40:51.023565 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 454/919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:50 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:51.212509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:51.214780 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:51.221281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:51.221764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:51.222198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:51.222929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:51.223556 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:51.224075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:51.254472 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a60d3cb6-3b01-476f-92c3-5fd0adea53ca tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045712 Nov 02 20:40:51.256031 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 466/920] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Nov 2 20:40:51 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:51.324835 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:51.325649 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:51.333241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:51.334045 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:51.334538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:51.335378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:51.335947 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:51.339427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:51.363046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:40:51.441649 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-da11f824-0be9-4c39-80b5-a7b5efa09e05 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 204 len: 0 microversion: 2.20 time: 0.120644 Nov 02 20:40:51.443636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 455/921] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 20:40:51 2022] DELETE /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 20:40:51.452168 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:51.452792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:51.460446 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:51.460933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:51.461362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:51.462059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:51.462518 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:51.462940 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:51.608556 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:51.618241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:51.619690 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:51.621097 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9854241a-c344-4aa4-84a6-3a37677cd3bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.172819 Nov 02 20:40:51.621811 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 467/922] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:40:51 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:40:52.048310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:52.048310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:52.054599 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:52.055177 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:52.055734 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:52.056531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:52.057050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:52.057541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:52.083378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 HTTP/1.1 Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:52.085690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:52.087110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '3074dbb7-dbe0-41cf-ad30-4671f3099eb5'} Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:52.088509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:52.090050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:52.091425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:52.091425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-abafef81-672d-498f-9781-71c2958b8f53 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 404 len: 111 microversion: 2.1 time: 0.045068 Nov 02 20:40:52.092480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 456/923] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:52 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:52.101110 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1a76443d-db06-4187-a247-b81a862bef42 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '.version_select at 0x7f2e220e2430>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:52.121021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1a76443d-db06-4187-a247-b81a862bef42 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244150046" status: 202 len: 0 microversion: 2.1 time: 0.023988 Nov 02 20:40:52.121688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 468/924] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 20:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244150046 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:40:52.652735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:52.652735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:52.657137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:52.657680 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:52.658170 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:52.658931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:52.659385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:52.659831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:52.802760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:52.811239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:52.812708 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:52.813879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-14aedccb-6dee-48a6-b8a5-c8e78b44f256 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.168684 Nov 02 20:40:52.814544 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 457/925] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:40:52 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:40:53.842032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:53.842680 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:53.849635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:53.850108 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:53.850533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:53.851214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:53.851679 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:53.852094 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:53.863596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:53.864867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:53.871222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:53.871734 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:53.872164 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:53.872847 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:53.873297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:53.873711 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:53.886911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 HTTP/1.1 Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:53.888522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.890078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '3074dbb7-dbe0-41cf-ad30-4671f3099eb5'} Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:53.893797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.895207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.896878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:53.896878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-80030edf-2995-490b-91ea-ee5e6e5a48c9 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 404 len: 111 microversion: 2.1 time: 0.030121 Nov 02 20:40:53.896878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 458/926] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:40:53 2022] DELETE /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 20:40:53.897943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:53.898548 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: 3074dbb7-dbe0-41cf-ad30-4671f3099eb5] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:53.904312 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:53.904784 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:53.905208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:53.905887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:53.906415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:53.906829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:53.920675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 HTTP/1.1 Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:53.922218 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.923661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '3074dbb7-dbe0-41cf-ad30-4671f3099eb5'} Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:53.924480 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. Nov 02 20:40:53.925915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:53.928019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance 3074dbb7-dbe0-41cf-ad30-4671f3099eb5 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:53.928019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c1fc8261-4241-4939-a6c4-79d345fe9923 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5" status: 404 len: 111 microversion: 2.1 time: 0.029279 Nov 02 20:40:53.928019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 459/927] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:53 2022] GET /compute/v2.1/servers/3074dbb7-dbe0-41cf-ad30-4671f3099eb5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:54.039120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:54.044952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:54.046419 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:54.047575 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f606b4f0-1514-4479-ab0b-680e5ff376bb tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1726 microversion: 2.20 time: 0.209371 Nov 02 20:40:54.048156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 469/928] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:40:53 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:40:54.838317 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-d0307b1e-9e63-4a0f-a855-5dba231942f5 req-2823de69-2173-4940-b5bf-5338a4d2125b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba7c8d9-10eb-437f-a0df-a276b941e16b", "name": "network-vif-deleted", "tag": "988104f9-4cc4-40c6-a3d5-9b7b5b41c840"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:40:54.848850 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-d0307b1e-9e63-4a0f-a855-5dba231942f5 req-2823de69-2173-4940-b5bf-5338a4d2125b service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:54.850747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-d0307b1e-9e63-4a0f-a855-5dba231942f5 req-2823de69-2173-4940-b5bf-5338a4d2125b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:54.851887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-d0307b1e-9e63-4a0f-a855-5dba231942f5 req-2823de69-2173-4940-b5bf-5338a4d2125b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:54.866756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-d0307b1e-9e63-4a0f-a855-5dba231942f5 req-2823de69-2173-4940-b5bf-5338a4d2125b service nova] Creating event network-vif-deleted:988104f9-4cc4-40c6-a3d5-9b7b5b41c840 for instance eba7c8d9-10eb-437f-a0df-a276b941e16b on hv-cinder-86236 Nov 02 20:40:54.873097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-d0307b1e-9e63-4a0f-a855-5dba231942f5 req-2823de69-2173-4940-b5bf-5338a4d2125b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038121 Nov 02 20:40:54.875095 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 460/929] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:40:55.074447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:55.075763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:55.089333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.091177 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:55.091796 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:55.092044 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.092698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.093641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.096213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.096916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.102279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.103152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.103640 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.104661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.107360 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.108182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.130209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 HTTP/1.1 Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:55.132042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.133382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'df50c4f6-8302-4c6e-8314-d3a70770bd44'} Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:55.134120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.135332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.136691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:55.136691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7bfbba19-da1f-4391-9d66-5e070893ff0b tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 404 len: 111 microversion: 2.1 time: 0.048136 Nov 02 20:40:55.136691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 461/930] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:40:55 2022] DELETE /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:55.142704 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:55.143315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: df50c4f6-8302-4c6e-8314-d3a70770bd44] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:55.152051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.152672 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.153100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.153807 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.154398 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.154817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.174339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.175123 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.175570 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.176047 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lazy-loading 'fault' on Instance uuid eba7c8d9-10eb-437f-a0df-a276b941e16b {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:40:55.181279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 HTTP/1.1 Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:55.182983 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.184707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'df50c4f6-8302-4c6e-8314-d3a70770bd44'} Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:55.185596 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. Nov 02 20:40:55.186874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.188020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance df50c4f6-8302-4c6e-8314-d3a70770bd44 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:55.188020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ec1df4b9-e1fd-4698-ba28-32ae7a26e47d tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44" status: 404 len: 111 microversion: 2.1 time: 0.047176 Nov 02 20:40:55.188020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 462/931] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:55 2022] GET /compute/v2.1/servers/df50c4f6-8302-4c6e-8314-d3a70770bd44 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:55.196962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:55.197472 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:55.204308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.204796 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.206153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.206877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.209061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.209711 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.214814 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:55.229138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf HTTP/1.1 Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:55.231419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.233393 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'fe76c605-d9b5-468d-afa3-326f156362bf'} Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:55.234154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.239764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.242508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:55.242508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5bcbd2ba-454d-4ec3-9209-e2c1c50c583e tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 404 len: 111 microversion: 2.1 time: 0.042955 Nov 02 20:40:55.242508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 463/932] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:40:55 2022] DELETE /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 20:40:55.242764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:55.248072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:55.249753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a86b6b9d9f54b3680efc6f3b93af3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a352130c2b84d68b1408eb2d0472d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:55.251107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7c843dab-8b4b-4af9-8bdf-c477dbfcb3c0 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 200 len: 1372 microversion: 2.20 time: 0.180840 Nov 02 20:40:55.251757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 470/933] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:40:55 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 20:40:55.258627 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:55.262297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: fe76c605-d9b5-468d-afa3-326f156362bf] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:55.269886 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.271138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.271634 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.273030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.273967 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.274397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.291044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf HTTP/1.1 Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:55.292540 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.294296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'fe76c605-d9b5-468d-afa3-326f156362bf'} Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:55.295937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. Nov 02 20:40:55.297415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:55.298726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance fe76c605-d9b5-468d-afa3-326f156362bf could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:55.298726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8e6d86c6-14fa-42e3-8e61-52c1e8d09848 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf" status: 404 len: 111 microversion: 2.1 time: 0.041446 Nov 02 20:40:55.298726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 464/934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:55 2022] GET /compute/v2.1/servers/fe76c605-d9b5-468d-afa3-326f156362bf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:55.497414 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:55.497992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:55.509101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.510269 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.510909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.512166 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:55.512695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:55.513576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:55.622705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lazy-loading 'services' on Instance uuid 8844201c-5219-44bd-915a-22fe1ddf6726 {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:40:55.729278 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-883accda-d7c5-4174-97a0-994bc1475dc0 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726/os-volume_attachments/100cbfdd-0e11-47e2-a78b-19eff7a543ff" status: 202 len: 0 microversion: 2.1 time: 0.234634 Nov 02 20:40:55.735811 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 471/935] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:40:55 2022] DELETE /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726/os-volume_attachments/100cbfdd-0e11-47e2-a78b-19eff7a543ff => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:40:56.277509 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:56.278116 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:56.292110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.292599 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.293026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.293724 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.294171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.294588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.309344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] HTTP exception thrown: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Request method failure captured: Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b HTTP/1.1 Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNl_otVLlOzOY1vLJqvMEJapxIFzBBw8mDFvEiyMnQZadyo2jLv3VLRWTBX3EVV96wZlqljSmGdeUE07gcrFVO8HB34O3ouY3LiPbMuB6EmcJwAVjjgIed6LgBN88gxhqOsgiCRb8p4QgZJlQBdvhklXQQUjj6dLhSwEYJJMEMXCYk Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:56.311123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}] Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 3a86b6b9d9f54b3680efc6f3b93af3db Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:56.312702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'eba7c8d9-10eb-437f-a0df-a276b941e16b'} Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:56.313462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:56.314659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.315929 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Returning 404 to user: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:56.315929 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3cce2f75-7e46-4ba4-9cc0-94cdece1baea tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 404 len: 111 microversion: 2.20 time: 0.038886 Nov 02 20:40:56.317543 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 465/936] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:40:56 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:40:56.324306 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-78792d5f-f3b3-470d-b841-223a42fdc990 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '.version_select at 0x7f2e22034d30>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:56.345268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-78792d5f-f3b3-470d-b841-223a42fdc990 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626136725" status: 204 len: 0 microversion: 2.20 time: 0.026636 Nov 02 20:40:56.346797 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 472/937] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Nov 2 20:40:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626136725 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 20:40:56.459843 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:56.460666 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:56.468064 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.468972 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.469689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.470565 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.471172 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.472288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.487999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f HTTP/1.1 Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:56.490811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'a8374bf3-0545-49a4-9acb-3616953c493f'} Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:56.493710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.495186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.497768 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:56.498791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4ba90796-9d91-4424-8bbc-b185e8de2dfc tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 404 len: 111 microversion: 2.1 time: 0.046137 Nov 02 20:40:56.499756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 466/938] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:40:56 2022] DELETE /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:56.509616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:56.511136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] [instance: a8374bf3-0545-49a4-9acb-3616953c493f] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:56.518686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.519189 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.519819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.521105 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.521774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.522518 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.538589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] HTTP exception thrown: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Request method failure captured: Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f HTTP/1.1 Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNbeTCDqz_R4QgmyytMSWr76jp4dw2cVLBHIfguR_I0AA1ZQtDJKig9uASx8zZ48_aHmdlNA5W9AMEG944X7XfbiqrBwd9KwnAAh2baOSw6xuOucCO8b6ycJN4_3OhG4fkQ4P73EvTY2LkYnaAz4TIi1ZkNtC_vK4XQQ4IpHM8QaYo Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:40:56.541298 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1f7a92134ad4771991bf954e6278efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1f7a92134ad4771991bf954e6278efe"}]}] Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: e1f7a92134ad4771991bf954e6278efe Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067055464 Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 89876cb8e3a040eca4ec8d15a2df0cae Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeNegativeTest-2067055464-project Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.542882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'a8374bf3-0545-49a4-9acb-3616953c493f'} Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:56.543638 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. Nov 02 20:40:56.544837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:56.545988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] Returning 404 to user: Instance a8374bf3-0545-49a4-9acb-3616953c493f could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:56.545988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b81f0521-0b81-4775-b89c-d07a22b1bd77 tempest-AttachVolumeNegativeTest-2067055464 tempest-AttachVolumeNegativeTest-2067055464-project] 10.222.0.26 "GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f" status: 404 len: 111 microversion: 2.1 time: 0.039081 Nov 02 20:40:56.545988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 473/939] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:56 2022] GET /compute/v2.1/servers/a8374bf3-0545-49a4-9acb-3616953c493f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:40:56.895968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:56.896930 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:56.903525 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.904396 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.904824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.906121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:56.907007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:56.907768 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:56.944409 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:40:57.046350 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ce564027-8694-4d25-bbcd-bedc817c92e8 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 204 len: 0 microversion: 2.1 time: 0.152268 Nov 02 20:40:57.048184 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 467/940] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:40:56 2022] DELETE /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:40:57.056792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:57.058259 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:57.070384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:57.071837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:57.072714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:57.073621 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:57.074250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:57.074900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:57.319838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:57.328753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0ccd06ef-4782-4d18-af5c-f47a15acdc38 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1512 microversion: 2.1 time: 0.276144 Nov 02 20:40:57.329542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 474/941] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:57 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:40:58.324561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:58.325997 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:58.337167 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:58.338043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:58.338734 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:58.340042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:58.340837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:58.341489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:58.352228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:58.353471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:58.361280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] HTTP exception thrown: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Request method failure captured: Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b HTTP/1.1 Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNl_otVLlOzOY1vLJqvMEJapxIFzBBw8mDFvEiyMnQZadyo2jLv3VLRWTBX3EVV96wZlqljSmGdeUE07gcrFVO8HB34O3ouY3LiPbMuB6EmcJwAVjjgIed6LgBN88gxhqOsgiCRb8p4QgZJlQBdvhklXQQUjj6dLhSwEYJJMEMXCYk Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:58.363793 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}] Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 3a86b6b9d9f54b3680efc6f3b93af3db Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.365217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'eba7c8d9-10eb-437f-a0df-a276b941e16b'} Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:58.365996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.367248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.368542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:58.368542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:58.368542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:58.368542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:58.370788 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Returning 404 to user: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:58.371111 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:58.372278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f8028124-2524-457c-a290-85040a28609b tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 404 len: 111 microversion: 2.20 time: 0.060269 Nov 02 20:40:58.373427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 468/942] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 20:40:58 2022] DELETE /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:40:58.373582 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:58.384097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:58.385474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: eba7c8d9-10eb-437f-a0df-a276b941e16b] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:58.392763 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:58.393292 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:58.393730 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:58.394448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:58.394910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:58.396315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:58.412943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] HTTP exception thrown: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Request method failure captured: Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b HTTP/1.1 Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNl_otVLlOzOY1vLJqvMEJapxIFzBBw8mDFvEiyMnQZadyo2jLv3VLRWTBX3EVV96wZlqljSmGdeUE07gcrFVO8HB34O3ouY3LiPbMuB6EmcJwAVjjgIed6LgBN88gxhqOsgiCRb8p4QgZJlQBdvhklXQQUjj6dLhSwEYJJMEMXCYk Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:58.414511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}] Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 3a86b6b9d9f54b3680efc6f3b93af3db Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.415931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'eba7c8d9-10eb-437f-a0df-a276b941e16b'} Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:58.416716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. Nov 02 20:40:58.417905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:58.418985 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Returning 404 to user: Instance eba7c8d9-10eb-437f-a0df-a276b941e16b could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:58.418985 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f2441585-62e0-4295-b25b-8271c4792351 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b" status: 404 len: 111 microversion: 2.20 time: 0.038228 Nov 02 20:40:58.420137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 469/943] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:40:58 2022] GET /compute/v2.1/servers/eba7c8d9-10eb-437f-a0df-a276b941e16b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:40:58.688230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:40:58.696375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:40:58.699862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-569bb520-8035-4062-8147-6911db10b4a6 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1512 microversion: 2.1 time: 0.351228 Nov 02 20:40:58.701114 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 475/944] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:58 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:40:59.653178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:59.653726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:59.661435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:59.662400 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:59.662914 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:59.663785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:59.664448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:59.671326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:59.687719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] HTTP exception thrown: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Request method failure captured: Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 HTTP/1.1 Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtNl_otVLlOzOY1vLJqvMEJapxIFzBBw8mDFvEiyMnQZadyo2jLv3VLRWTBX3EVV96wZlqljSmGdeUE07gcrFVO8HB34O3ouY3LiPbMuB6EmcJwAVjjgIed6LgBN88gxhqOsgiCRb8p4QgZJlQBdvhklXQQUjj6dLhSwEYJJMEMXCYk Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:40:59.689973 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}] Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 3a86b6b9d9f54b3680efc6f3b93af3db Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.692202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '6257b48a-e22b-448d-a9be-458c3c9517c9'} Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:59.696411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.697614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.698785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Returning 404 to user: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:59.698785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0bfd31ca-0331-4904-ad98-5dccd69033ac tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 404 len: 111 microversion: 2.20 time: 0.043764 Nov 02 20:40:59.698785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 470/945] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 20:40:59 2022] DELETE /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:40:59.702944 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:59.703559 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] [instance: 6257b48a-e22b-448d-a9be-458c3c9517c9] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:59.713874 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:59.714678 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:59.715293 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:59.716271 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:59.716731 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:59.717158 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:59.736517 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] HTTP exception thrown: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Request method failure captured: Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 HTTP/1.1 Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtNl_otVLlOzOY1vLJqvMEJapxIFzBBw8mDFvEiyMnQZadyo2jLv3VLRWTBX3EVV96wZlqljSmGdeUE07gcrFVO8HB34O3ouY3LiPbMuB6EmcJwAVjjgIed6LgBN88gxhqOsgiCRb8p4QgZJlQBdvhklXQQUjj6dLhSwEYJJMEMXCYk Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:40:59.740329 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a352130c2b84d68b1408eb2d0472d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a352130c2b84d68b1408eb2d0472d12"}]}] Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 2a352130c2b84d68b1408eb2d0472d12 Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631170958 Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 3a86b6b9d9f54b3680efc6f3b93af3db Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631170958-project Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.742162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '6257b48a-e22b-448d-a9be-458c3c9517c9'} Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:40:59.747285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. Nov 02 20:40:59.748816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:40:59.750198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] Returning 404 to user: Instance 6257b48a-e22b-448d-a9be-458c3c9517c9 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:40:59.750198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-fd18622a-b11a-47b4-9191-5421346597b7 tempest-AttachVolumeShelveTestJSON-1631170958 tempest-AttachVolumeShelveTestJSON-1631170958-project] 10.222.0.26 "GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9" status: 404 len: 111 microversion: 2.20 time: 0.042820 Nov 02 20:40:59.750381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:40:59.750482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 476/946] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 20:40:59 2022] GET /compute/v2.1/servers/6257b48a-e22b-448d-a9be-458c3c9517c9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 20:40:59.750581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:40:59.758410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:59.759107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:59.761178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:40:59.762538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:40:59.762978 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:40:59.763589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:00.308013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ace8b734d4304bf68ccf9436a702f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0986044b31c543f6abc0adecffefb929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:00.318053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6e64b67e-c4d1-46ad-a2b1-a1d1679526e9 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 200 len: 1512 microversion: 2.1 time: 0.596523 Nov 02 20:41:00.319903 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 471/947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:40:59 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:00.536943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-747c1333-0781-44a7-9020-a7ea5042866f req-83b989b4-944d-49eb-9f7f-b82187bd5c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8844201c-5219-44bd-915a-22fe1ddf6726", "name": "network-vif-deleted", "tag": "0f65f3f1-8c11-4161-aef3-b30c3535b81d"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:41:00.561514 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-747c1333-0781-44a7-9020-a7ea5042866f req-83b989b4-944d-49eb-9f7f-b82187bd5c94 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:00.564373 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-747c1333-0781-44a7-9020-a7ea5042866f req-83b989b4-944d-49eb-9f7f-b82187bd5c94 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:00.565447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-747c1333-0781-44a7-9020-a7ea5042866f req-83b989b4-944d-49eb-9f7f-b82187bd5c94 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:00.594274 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-747c1333-0781-44a7-9020-a7ea5042866f req-83b989b4-944d-49eb-9f7f-b82187bd5c94 service nova] Creating event network-vif-deleted:0f65f3f1-8c11-4161-aef3-b30c3535b81d for instance 8844201c-5219-44bd-915a-22fe1ddf6726 on hv-cinder-86236 Nov 02 20:41:00.602554 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-747c1333-0781-44a7-9020-a7ea5042866f req-83b989b4-944d-49eb-9f7f-b82187bd5c94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257288 Nov 02 20:41:00.603163 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 477/948] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:41:01.344947 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:01.346937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] [instance: 8844201c-5219-44bd-915a-22fe1ddf6726] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:01.358578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:01.359070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:01.359576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:01.360310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:01.360902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:01.362956 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:01.381146 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] HTTP exception thrown: Instance 8844201c-5219-44bd-915a-22fe1ddf6726 could not be found. Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Request method failure captured: Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 HTTP/1.1 Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtVBf2TMWtGcXcnwPmrkVCXK8U7udZ7jY32h4kP5_3foSMcZLs2H7V4ns8LDIKCSiBDhCom-De4pPlodU1YC9mDR41t1PhKUAEqq1NVlr4oDMeBeIO-grmV7SrFDNtEGoVZBX19Q-_3Y7yv6nb1KXrAvLToGMWjcB3yQjzZ927mkAmI Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 0986044b31c543f6abc0adecffefb929 Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1362961242 Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:41:01.383820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0986044b31c543f6abc0adecffefb929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0986044b31c543f6abc0adecffefb929"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0986044b31c543f6abc0adecffefb929"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0986044b31c543f6abc0adecffefb929"}]}] Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-VolumesSnapshotTestJSON-1362961242 Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 0986044b31c543f6abc0adecffefb929 Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1362961242 Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-VolumesSnapshotTestJSON-1362961242-project Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 7c5ace8b734d4304bf68ccf9436a702f Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-VolumesSnapshotTestJSON-1362961242-project Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 8844201c-5219-44bd-915a-22fe1ddf6726 could not be found. Nov 02 20:41:01.385185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '8844201c-5219-44bd-915a-22fe1ddf6726'} Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8844201c-5219-44bd-915a-22fe1ddf6726 could not be found. Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:41:01.386102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8844201c-5219-44bd-915a-22fe1ddf6726 could not be found. Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8844201c-5219-44bd-915a-22fe1ddf6726 could not be found. Nov 02 20:41:01.387532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:41:01.392541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] Returning 404 to user: Instance 8844201c-5219-44bd-915a-22fe1ddf6726 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:41:01.393563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6c3b406f-95ac-4d06-988d-2621b95c5d67 tempest-VolumesSnapshotTestJSON-1362961242 tempest-VolumesSnapshotTestJSON-1362961242-project] 10.222.0.26 "GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726" status: 404 len: 111 microversion: 2.1 time: 0.055103 Nov 02 20:41:01.397806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 472/949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:01 2022] GET /compute/v2.1/servers/8844201c-5219-44bd-915a-22fe1ddf6726 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:41:09.248800 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-71931015-8451-432c-bad4-63df93bd876f tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e220c50d0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:09.306557 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-71931015-8451-432c-bad4-63df93bd876f tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8731e06e-d9b4-4ae6-a4ca-2949dc327f43" status: 200 len: 351 microversion: 2.1 time: 0.061997 Nov 02 20:41:09.307131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 478/950] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:41:09 2022] GET /compute/v2.1/os-volumes/8731e06e-d9b4-4ae6-a4ca-2949dc327f43 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:10.711419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d0fffd0e-ad17-4544-8c74-6ed1b81ad39a tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e2235a550>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:10.778611 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d0fffd0e-ad17-4544-8c74-6ed1b81ad39a tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cf687514-00b4-4cc7-a40a-ea855b789043" status: 200 len: 350 microversion: 2.1 time: 0.071921 Nov 02 20:41:10.780076 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 473/951] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:41:10 2022] GET /compute/v2.1/os-volumes/cf687514-00b4-4cc7-a40a-ea855b789043 => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:12.184859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:12.185595 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=4 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:12.189950 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-dedd9da7-d1c4-4920-b241-45fa9dcc62b8 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e2201af70>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:12.236683 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-dedd9da7-d1c4-4920-b241-45fa9dcc62b8 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cc026ef5-c522-489c-9602-27519757a4b5" status: 200 len: 351 microversion: 2.1 time: 0.053129 Nov 02 20:41:12.237253 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 479/952] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes/cc026ef5-c522-489c-9602-27519757a4b5 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:12.247728 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:12.248593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:12.253036 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e5ac4fcc-0849-4d70-a274-fab6b71c1f38 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e22408d30>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:12.366452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e5ac4fcc-0849-4d70-a274-fab6b71c1f38 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.119319 Nov 02 20:41:12.367051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 474/953] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:12.382052 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-82f62543-dfc4-4574-bf8b-715a269a62b6 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e22085280>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:12.472518 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-82f62543-dfc4-4574-bf8b-715a269a62b6 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095169 Nov 02 20:41:12.473087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 480/954] 10.222.0.26 () {58 vars in 1149 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:41:12.489357 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dd5c6fac-b80b-43a0-a4b2-46f8e576814c tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e222a7670>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:12.591339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dd5c6fac-b80b-43a0-a4b2-46f8e576814c tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.107227 Nov 02 20:41:12.591940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 475/955] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:12.605322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-dbb6e9b2-dc5f-4e30-ad49-3398b2e207fd tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e22034ee0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:12.716202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-dbb6e9b2-dc5f-4e30-ad49-3398b2e207fd tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.114445 Nov 02 20:41:12.716767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 481/956] 10.222.0.26 () {58 vars in 1167 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:12.732861 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d6af41df-a384-4f74-93b2-d1d9d4212834 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e222a7550>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:12.815126 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d6af41df-a384-4f74-93b2-d1d9d4212834 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086056 Nov 02 20:41:12.815756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 476/957] 10.222.0.26 () {58 vars in 1170 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:12.830869 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c3dfba8f-3602-40c2-bd52-ad6b15de3b5c tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e21ff1040>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:12.914024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c3dfba8f-3602-40c2-bd52-ad6b15de3b5c tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087475 Nov 02 20:41:12.914597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 482/958] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:12.928534 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cd771bbe-a47a-4f20-8013-988b692f07d7 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e2235ac10>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:13.009515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cd771bbe-a47a-4f20-8013-988b692f07d7 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085280 Nov 02 20:41:13.010108 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 477/959] 10.222.0.26 () {58 vars in 1188 bytes} [Wed Nov 2 20:41:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:13.023458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f5913698-4cef-4735-a0ab-8d6868a283d9 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] Calling method '.version_select at 0x7f2e2201aee0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:13.107004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f5913698-4cef-4735-a0ab-8d6868a283d9 tempest-VolumesTestJSON-1442730350 tempest-VolumesTestJSON-1442730350-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087285 Nov 02 20:41:13.107568 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 483/960] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Nov 2 20:41:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:13.630612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1829211914", "imageRef": "de14b3ac-2fc4-40e6-87a2-100d948934bf", "flavorRef": "452"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:41:13.683506 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] validate_networks() for None {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:41:13.979795 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:41:13.980215 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:41:13.980681 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:41:13.981086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:41:13.981491 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:41:13.990173 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:13.990650 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:13.991699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:13.992430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:13.992879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:13.993298 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:14.010510 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Getting quotas for project 350687eb550748edabc44822dde0bb99. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:41:14.014589 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Getting quotas for user caeb81cc1285424280c229cd99954115 and project 350687eb550748edabc44822dde0bb99. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:41:14.025644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:41:14.027936 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de14b3ac-2fc4-40e6-87a2-100d948934bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:41:14.072814 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0d8a7cdb-9c94-4d41-a131-7490baedfc50 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.446383 Nov 02 20:41:14.077195 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 478/961] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:41:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:41:14.085342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-67dd8427-7a75-4aa3-9fa1-21f292b7a4b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:14.086305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-67dd8427-7a75-4aa3-9fa1-21f292b7a4b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:14.142230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-67dd8427-7a75-4aa3-9fa1-21f292b7a4b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:14.149869 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-67dd8427-7a75-4aa3-9fa1-21f292b7a4b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1215 microversion: 2.1 time: 0.069216 Nov 02 20:41:14.150482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 484/962] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:14 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:41:15.173318 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:15.173928 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:15.181208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:15.181688 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:15.182117 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:15.182801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:15.183253 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:15.183707 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:15.244217 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:15.251782 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cae6133e-5965-457c-ba82-f7bfeba10955 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1219 microversion: 2.1 time: 0.082393 Nov 02 20:41:15.252340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 479/963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:15 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:16.275664 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:16.276188 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:16.283379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:16.283922 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:16.284353 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:16.285041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:16.285490 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:16.285910 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:16.349667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:16.357618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-51882478-2cc9-4d49-9297-40ce73006398 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1219 microversion: 2.1 time: 0.086732 Nov 02 20:41:16.358509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 485/964] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:16 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:17.380294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:17.380905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:17.387390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:17.387899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:17.388337 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:17.389022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:17.389481 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:17.389907 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:17.456676 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:17.464878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b49681db-d895-4d82-acca-592877e384cf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1267 microversion: 2.1 time: 0.088408 Nov 02 20:41:17.465449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 480/965] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:17 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:18.488174 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:18.488780 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:18.501549 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:18.502149 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:18.502712 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:18.503434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:18.503923 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:18.504345 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:18.645153 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:18.653567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e3464578-b4d9-4525-a043-c2f76fb86e49 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.169169 Nov 02 20:41:18.654136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 486/966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:18 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:19.676414 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:19.677021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:19.683464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:19.683982 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:19.684419 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:19.685133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:19.685588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:19.686014 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:19.812629 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:19.820486 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e8aee724-8366-4315-a1c1-15c02bd004f9 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.148019 Nov 02 20:41:19.821044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 481/967] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:19 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:20.843413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:20.844046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:20.850852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:20.851517 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:20.851971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:20.852702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:20.853100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:20.853515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:20.982349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:20.989869 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1f2b6c56-5ba8-40fd-b032-d4b40aa2ec94 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.150279 Nov 02 20:41:20.990430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 487/968] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:20 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:22.013405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:22.014021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:22.020405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:22.020890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:22.021322 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:22.022500 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:22.023175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:22.023691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:22.097206 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-afc9349a-b964-4fb4-9ff2-35bef1375e02 req-3f456bf5-c4c0-4612-925d-399d4f616ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cdb93de-904c-4c09-9c24-1591a31f1b03", "tag": "fb3a3d00-310d-459b-be8a-9cd00366de23"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:41:22.109152 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-afc9349a-b964-4fb4-9ff2-35bef1375e02 req-3f456bf5-c4c0-4612-925d-399d4f616ffd service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:22.109801 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-afc9349a-b964-4fb4-9ff2-35bef1375e02 req-3f456bf5-c4c0-4612-925d-399d4f616ffd service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:22.110697 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-afc9349a-b964-4fb4-9ff2-35bef1375e02 req-3f456bf5-c4c0-4612-925d-399d4f616ffd service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:22.123574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-afc9349a-b964-4fb4-9ff2-35bef1375e02 req-3f456bf5-c4c0-4612-925d-399d4f616ffd service nova] Creating event network-changed:fb3a3d00-310d-459b-be8a-9cd00366de23 for instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 on hv-cinder-86236 Nov 02 20:41:22.128582 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-afc9349a-b964-4fb4-9ff2-35bef1375e02 req-3f456bf5-c4c0-4612-925d-399d4f616ffd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035662 Nov 02 20:41:22.129418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 488/969] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:22.164649 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:22.172311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1cad3df1-dcde-4934-bb6a-a06a369f15a2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.162828 Nov 02 20:41:22.172878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 482/970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:22 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:23.195952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:23.196676 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:23.202573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:23.203053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:23.203487 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:23.204208 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:23.204659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:23.205078 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:23.335892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:23.343585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a0baf827-56a0-46fc-bb9d-409afc653703 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.153098 Nov 02 20:41:23.344183 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 489/971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:23 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:24.368413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:24.369030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:24.371375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:24.372054 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=6 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:24.377920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:24.378405 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:24.378840 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:24.379532 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:24.380018 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:24.380441 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:24.515977 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:24.523734 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-00c589ab-8473-44bc-a70c-c260b7c928b4 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.159775 Nov 02 20:41:24.529543 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 483/972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:24 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:25.546114 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:25.546727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:25.548838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:25.555260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:25.555783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:25.556268 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:25.557036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:25.557498 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:25.557985 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:25.689368 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:25.697748 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e4b5b39e-1691-463b-8d59-424f0e0546ca tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.155475 Nov 02 20:41:25.698309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 490/973] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:25 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:26.719667 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:26.720279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:26.727584 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:26.728102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:26.728539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:26.729235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:26.729690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:26.730119 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:26.861121 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:26.869290 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4c659b2d-ec3e-49e2-9278-f58cf56ebc15 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.153486 Nov 02 20:41:26.869860 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 484/974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:26 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:27.891838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:27.892441 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:27.898931 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:27.899406 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:27.899859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:27.900536 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:27.900984 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:27.901399 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:28.029318 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:28.037410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3e2a4961-292d-4353-a66a-10f72ed64efc tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.149419 Nov 02 20:41:28.037975 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 491/975] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:27 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:29.061141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:29.061752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:29.068624 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:29.069110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:29.069831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:29.071084 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:29.071547 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:29.071991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:29.206729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:29.215263 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f1763012-4f68-49a6-8853-e84b3c0d8534 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.157897 Nov 02 20:41:29.215874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 485/976] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:29 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:30.239673 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:30.240313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:30.247425 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:30.247942 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:30.248375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:30.249069 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:30.249562 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:30.249945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:30.393432 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:30.401010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-82c390c7-62aa-4b58-93ff-006f92d815b2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.165246 Nov 02 20:41:30.401665 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 492/977] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:30 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:31.423808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:31.424473 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:31.431992 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:31.432471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:31.432899 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:31.433594 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:31.434049 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:31.434471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:31.569837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:31.578999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-067bdd4e-b50a-4924-a2d8-918fa944947b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.159061 Nov 02 20:41:31.579701 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 486/978] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:31 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:32.602889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:32.603738 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:32.609926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:32.610404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:32.610833 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:32.611529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:32.612041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:32.612476 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:32.753728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:32.762462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-fa07be37-8529-4a6d-accf-6481e22a197b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.163903 Nov 02 20:41:32.763205 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 493/979] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:32 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:33.786887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:33.787491 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:33.793970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:33.794447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:33.794871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:33.795553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:33.796068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:33.796508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:33.930995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:33.938738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-04492bea-fe0a-4787-9d6c-ea5704d9810e tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.155811 Nov 02 20:41:33.939235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 487/980] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:33 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:34.962846 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:34.963488 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:34.970238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:34.970712 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:34.971139 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:34.972072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:34.972528 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:34.972945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:35.112667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:35.120555 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9b5340f3-844a-45c7-bc14-ecb684400315 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.162207 Nov 02 20:41:35.121308 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 494/981] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:34 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:36.115075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-75209544-cb4e-4da8-8703-cba1a5089dba req-5c4c761f-54e3-44de-95d0-30e9bacc2deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdb93de-904c-4c09-9c24-1591a31f1b03", "name": "network-vif-plugged", "status": "completed", "tag": "fb3a3d00-310d-459b-be8a-9cd00366de23"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:41:36.124756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-75209544-cb4e-4da8-8703-cba1a5089dba req-5c4c761f-54e3-44de-95d0-30e9bacc2deb service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:36.125416 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-75209544-cb4e-4da8-8703-cba1a5089dba req-5c4c761f-54e3-44de-95d0-30e9bacc2deb service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:36.125903 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-75209544-cb4e-4da8-8703-cba1a5089dba req-5c4c761f-54e3-44de-95d0-30e9bacc2deb service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:36.138225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-75209544-cb4e-4da8-8703-cba1a5089dba req-5c4c761f-54e3-44de-95d0-30e9bacc2deb service nova] Creating event network-vif-plugged:fb3a3d00-310d-459b-be8a-9cd00366de23 for instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 on hv-cinder-86236 Nov 02 20:41:36.143080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-75209544-cb4e-4da8-8703-cba1a5089dba req-5c4c761f-54e3-44de-95d0-30e9bacc2deb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155378 Nov 02 20:41:36.143691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 488/982] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:36.143992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:36.144607 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:36.151790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:36.152264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:36.152767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:36.153454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:36.153904 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:36.154319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:36.301334 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:36.309807 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f3557b78-a8b2-447e-9e6e-58ff3ef80f45 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.170328 Nov 02 20:41:36.310485 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 495/983] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:36 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:41:37.333491 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:37.334104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:37.340350 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:37.340830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:37.341260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:37.341948 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:37.342399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:37.342820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:37.472922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:37.481067 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5d394482-8bdd-4395-853a-6a807b79b72b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.152360 Nov 02 20:41:37.481628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 489/984] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:37 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:38.503948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:38.504558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:38.511523 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:38.512026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:38.512456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:38.513143 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:38.513585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:38.514003 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:38.646203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:38.653785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ef05dbc3-a1fe-4253-b813-ee56b97e8bcd tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.153683 Nov 02 20:41:38.654349 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 496/985] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:38 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:39.676209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:39.676815 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:39.683224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:39.683675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:39.684137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:39.684818 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:39.685267 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:39.685685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:39.815738 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:39.824087 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3ad71b66-4cc4-485b-9354-45948eaa0892 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.151737 Nov 02 20:41:39.824652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 490/986] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:39 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:40.846470 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:40.847080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:40.854352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:40.854834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:40.855264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:40.855988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:40.856444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:40.856868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:40.986617 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:40.994339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-661b4b30-a02f-487b-8ef9-4b7c6343f5f0 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.151741 Nov 02 20:41:40.995017 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 497/987] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:40 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:42.017332 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:42.018017 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:42.024857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:42.025315 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:42.025746 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:42.026471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:42.027098 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:42.027525 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:42.173239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:42.181740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7c46af7a-6095-43ea-bcae-8ee89206b687 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1315 microversion: 2.1 time: 0.167985 Nov 02 20:41:42.182306 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 491/988] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:42 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:43.205177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:43.206366 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:43.208545 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=31 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:43.215070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:43.215550 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:43.216004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:43.216701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:43.217151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:43.217571 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:43.220232 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=75 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:43.352733 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:43.360333 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d0135be5-7040-4157-9d89-ad45cfd5c427 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1465 microversion: 2.1 time: 0.158988 Nov 02 20:41:43.360898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 498/989] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:43 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:43.407399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:43.407913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:43.410308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:43.415855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:43.416341 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:43.416773 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:43.417464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:43.417968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:43.418384 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:43.421747 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=77 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:41:43.447229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:41:43.522062 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-eeb95c21-874e-4c21-94fa-e334ebd639d3 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 204 len: 0 microversion: 2.1 time: 0.118021 Nov 02 20:41:43.522536 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 492/990] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:41:43 2022] DELETE /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:41:43.531899 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:43.532509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:43.538620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:43.539105 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:43.539726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:43.540687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:43.541142 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:43.541617 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:43.675883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:43.684016 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-feaa0714-fc0f-41a1-8ecf-3a538f41003b tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.156157 Nov 02 20:41:43.684579 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 499/991] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:43 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:41:44.708946 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:44.709671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:44.716439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:44.716925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:44.717360 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:44.718051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:44.718506 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:44.718926 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:44.868404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:44.876563 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-36c344c7-4861-4042-a6f1-b77dc8f5f87d tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.171919 Nov 02 20:41:44.877137 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 493/992] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:44 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:41:45.900231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:45.901647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:45.908094 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:45.908569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:45.908993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:45.909685 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:45.910134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:45.910682 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:46.098245 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:46.106394 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d840c66f-af50-45bf-a779-a10b09b22753 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.210102 Nov 02 20:41:46.107214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 500/993] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:45 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:47.130748 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:47.132076 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:47.140692 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:47.141352 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:47.142005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:47.142950 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:47.143669 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:47.144317 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:47.591285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:47.601523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-26f59b1a-b0ec-4e15-b0b8-959a12e7bdaf tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.474915 Nov 02 20:41:47.603014 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 494/994] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:47 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:48.629613 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:48.630226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:48.636868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:48.638130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:48.638568 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:48.639279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:48.639769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:48.640198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:48.793687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:48.802035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f3b2b392-f446-4e21-922a-0ad7bf870dc8 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.176699 Nov 02 20:41:48.811664 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 501/995] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:48 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:49.828815 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:49.829639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:49.836723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:49.837467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:49.837994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:49.838789 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:49.839439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:49.840226 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:50.087086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:50.095148 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5b25c543-61b9-4746-85bd-5b4905649c35 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.270192 Nov 02 20:41:50.095760 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 495/996] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:49 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:51.120679 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:51.121353 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:51.128418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:51.129226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:51.129994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:51.131151 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:51.131915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:51.132377 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:51.337125 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:51.346283 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-376f7f00-66a9-40c3-96e4-a28d9d4363db tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.230213 Nov 02 20:41:51.346862 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 502/997] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:51 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:52.373080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:52.373703 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:52.381222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:52.381720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:52.382160 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:52.382905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:52.383369 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:52.383824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:52.565558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:52.577715 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3f05141f-6229-41b7-a5ef-24ccabc265d2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1471 microversion: 2.1 time: 0.210828 Nov 02 20:41:52.592737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 496/998] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:52 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:53.140422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-9adc17ce-5160-46e8-92d3-35eb763646c3 req-54bbc35c-32dc-4b62-ad31-d38d6789e4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdb93de-904c-4c09-9c24-1591a31f1b03", "name": "network-vif-deleted", "tag": "fb3a3d00-310d-459b-be8a-9cd00366de23"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:41:53.154805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-9adc17ce-5160-46e8-92d3-35eb763646c3 req-54bbc35c-32dc-4b62-ad31-d38d6789e4ef service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:53.155740 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-9adc17ce-5160-46e8-92d3-35eb763646c3 req-54bbc35c-32dc-4b62-ad31-d38d6789e4ef service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:53.156384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-9adc17ce-5160-46e8-92d3-35eb763646c3 req-54bbc35c-32dc-4b62-ad31-d38d6789e4ef service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:53.188515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-9adc17ce-5160-46e8-92d3-35eb763646c3 req-54bbc35c-32dc-4b62-ad31-d38d6789e4ef service nova] Creating event network-vif-deleted:fb3a3d00-310d-459b-be8a-9cd00366de23 for instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 on hv-cinder-86236 Nov 02 20:41:53.195114 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-9adc17ce-5160-46e8-92d3-35eb763646c3 req-54bbc35c-32dc-4b62-ad31-d38d6789e4ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058889 Nov 02 20:41:53.205289 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 503/999] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:41:53.605542 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:53.606220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:53.617261 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:53.617755 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:53.618077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:53.619147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:53.619911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:53.620538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:53.666399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:53.667241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:53.667897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:53.668514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lazy-loading 'fault' on Instance uuid 4cdb93de-904c-4c09-9c24-1591a31f1b03 {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:41:53.722235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caeb81cc1285424280c229cd99954115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350687eb550748edabc44822dde0bb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:41:53.746731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-cb7eef30-6d94-457e-a47a-2b86af8b2ba7 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 200 len: 1305 microversion: 2.1 time: 0.146988 Nov 02 20:41:53.747327 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 497/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:53 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:41:54.775211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:41:54.776702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] [instance: 4cdb93de-904c-4c09-9c24-1591a31f1b03] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:41:54.784489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:54.785341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:54.785991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:54.786924 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:41:54.787646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:41:54.788291 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:41:54.806357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] HTTP exception thrown: Instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 could not be found. Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Request method failure captured: Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 HTTP/1.1 Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtXozlIGjiOEwSpL0KzoK_VLooJTGPMXS9C9fzXZVGgKsV7PD-v438GLqPrxqJ17HStfC7-T_bsrQ6cyEqXog4gGdv9HnN9G_MnznWjz-TIJk2MbA7xLJxtSdSOuSxIM2eokpikbgkC9X4rIpavnbWAfqtiOFDmdUYx00o1K5ocddbE Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 350687eb550748edabc44822dde0bb99 Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-VolumesNegativeTest-1965894238 Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:41:54.808455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/350687eb550748edabc44822dde0bb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/350687eb550748edabc44822dde0bb99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_350687eb550748edabc44822dde0bb99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/350687eb550748edabc44822dde0bb99"}]}] Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-VolumesNegativeTest-1965894238 Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 350687eb550748edabc44822dde0bb99 Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-VolumesNegativeTest-1965894238 Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-VolumesNegativeTest-1965894238-project Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: caeb81cc1285424280c229cd99954115 Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-VolumesNegativeTest-1965894238-project Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 could not be found. Nov 02 20:41:54.809920 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '4cdb93de-904c-4c09-9c24-1591a31f1b03'} Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 could not be found. Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:41:54.810769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 could not be found. Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 could not be found. Nov 02 20:41:54.812129 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:41:54.814750 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] Returning 404 to user: Instance 4cdb93de-904c-4c09-9c24-1591a31f1b03 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:41:54.815952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-45738359-f12e-4daf-ad0e-dcc0e5d516e2 tempest-VolumesNegativeTest-1965894238 tempest-VolumesNegativeTest-1965894238-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03" status: 404 len: 111 microversion: 2.1 time: 0.045788 Nov 02 20:41:54.816756 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 504/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:41:54 2022] GET /compute/v2.1/servers/4cdb93de-904c-4c09-9c24-1591a31f1b03 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:41:57.122837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e780726a-01ef-4390-bb80-100ba175e2a1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Action: 'create', calling method: .version_select at 0x7f2e22403c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1643622842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIkNlUHG9Tx1m7CbXMOdIUlQbjo3uIkkuJRD4yPZGdJcb1ejNzVQIVrCT5XCaunzzsqxcEOES5C2Hcbsm1s1wZpSW2F2/m3grZgHXpbrhDALJYNN4UGxovyBo6WAeJBUQ=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:41:57.159151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-e780726a-01ef-4390-bb80-100ba175e2a1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for project 02f491b87b30459495465d90dece762c. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:41:57.166729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-e780726a-01ef-4390-bb80-100ba175e2a1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for user d128e7c1d70c41c29e5ac77d59378fac and project 02f491b87b30459495465d90dece762c. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:41:57.196620 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e780726a-01ef-4390-bb80-100ba175e2a1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.277788 Nov 02 20:41:57.197358 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 498/1002] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:41:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:42:30.974119 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-75840730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1643622842", "security_groups": [{"name": "tempest-secgroup-smoke-957565563"}], "block_device_mapping_v2": [{"uuid": "e2bf28b1-f298-4a81-8d48-dbc18cc9fb7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7606db48-5c2f-421e-bbd0-08f46d425024"}]}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:42:30.985359 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=13 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:30.986018 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=33 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:31.100789 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] validate_networks() for [('7606db48-5c2f-421e-bbd0-08f46d425024', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:42:31.664459 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:42:31.664880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:42:31.665991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:42:31.667056 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:42:31.667475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:42:31.676962 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:31.677520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:31.677961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:31.678692 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:31.679150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:31.679578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:31.698531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for project 02f491b87b30459495465d90dece762c. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:42:31.702849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for user d128e7c1d70c41c29e5ac77d59378fac and project 02f491b87b30459495465d90dece762c. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:42:31.878990 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:42:31.882115 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e2bf28b1-f298-4a81-8d48-dbc18cc9fb7f',volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:42:32.061245 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-29f94980-bcab-4a5c-b021-446c6ebae0aa tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.090979 Nov 02 20:42:32.062397 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 505/1003] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:42:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:42:32.073465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:32.076053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=4 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:32.076991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:32.082381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-115ad128-b631-4f51-be81-4541cb221769 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:32.083457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-115ad128-b631-4f51-be81-4541cb221769 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:32.169102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-115ad128-b631-4f51-be81-4541cb221769 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:32.176689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-115ad128-b631-4f51-be81-4541cb221769 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1093 microversion: 2.1 time: 0.106865 Nov 02 20:42:32.178655 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 499/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:32 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1093 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:33.202795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:33.204263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:33.211849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:33.213008 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:33.214210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:33.215007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:33.223946 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:33.224613 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:33.303011 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:33.312733 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-98ced3fc-81d2-41ea-8fa6-c851fb825f5a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1209 microversion: 2.1 time: 0.114553 Nov 02 20:42:33.313311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 506/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:33 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:42:34.338030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:34.339380 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:34.346087 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:34.346696 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:34.347246 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:34.348102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:34.348656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:34.349154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:34.494709 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:34.503602 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-52a7772d-9850-41fc-a2ee-7af00602b783 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.172058 Nov 02 20:42:34.516867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 500/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:34 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:34.804421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-87eb4bd3-9d22-4377-9f0a-ca3a4d60963c req-c2960592-e703-42dc-b50f-5e30d547563b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88fb0dd-4264-4940-a1d4-7a56d751faad", "tag": "bb534f95-1c47-4df0-8a15-827a9f438115"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:42:34.817218 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-87eb4bd3-9d22-4377-9f0a-ca3a4d60963c req-c2960592-e703-42dc-b50f-5e30d547563b service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:34.817852 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-87eb4bd3-9d22-4377-9f0a-ca3a4d60963c req-c2960592-e703-42dc-b50f-5e30d547563b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:34.818640 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-87eb4bd3-9d22-4377-9f0a-ca3a4d60963c req-c2960592-e703-42dc-b50f-5e30d547563b service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:34.831532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-87eb4bd3-9d22-4377-9f0a-ca3a4d60963c req-c2960592-e703-42dc-b50f-5e30d547563b service nova] Creating event network-changed:bb534f95-1c47-4df0-8a15-827a9f438115 for instance e88fb0dd-4264-4940-a1d4-7a56d751faad on hv-cinder-86236 Nov 02 20:42:34.837585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-87eb4bd3-9d22-4377-9f0a-ca3a4d60963c req-c2960592-e703-42dc-b50f-5e30d547563b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036395 Nov 02 20:42:34.838649 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 507/1007] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:42:35.530996 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:35.532042 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:35.538467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:35.538928 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:35.539351 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:35.540347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:35.540504 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:35.541073 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:35.676254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:35.684890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7cceaf63-21ab-4d49-9464-e2708f4aad41 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.158271 Nov 02 20:42:35.685459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 501/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:35 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:36.708007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:36.708741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:36.715529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:36.716029 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:36.716469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:36.717159 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:36.717612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:36.718032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:36.902103 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:36.910960 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a085a9c3-306f-4068-94f9-2abe495861c0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.207531 Nov 02 20:42:36.914680 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 508/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:36 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:37.935100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:37.935821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:37.942346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:37.942919 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:37.943354 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:37.944125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:37.944617 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:37.945336 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:38.083310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:38.093007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-3e153e1e-38f9-4eb1-8d13-76cab715aaaf tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.162408 Nov 02 20:42:38.093612 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 502/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:37 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:39.117301 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:39.118032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:39.125098 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:39.125581 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:39.126005 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:39.126689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:39.127133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:39.127565 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:39.279532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:39.287204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1b25cacc-2724-432a-b268-86c23af08fba tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.173990 Nov 02 20:42:39.287833 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 509/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:39 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:42:40.310175 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:40.310789 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:40.317075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:40.317557 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:40.317987 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:40.318677 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:40.319136 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:40.319558 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:40.450476 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:40.458154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ef44cfc0-5815-4de2-b8ec-ab9783fb2b2f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.152459 Nov 02 20:42:40.458720 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 503/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:40 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:41.481901 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:41.482515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:41.489104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:41.489587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:41.490025 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:41.490744 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:41.491199 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:41.491652 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:41.621328 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:41.629036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-66b68102-5e53-4e66-90df-a52d3bb671d0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.151627 Nov 02 20:42:41.629608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 510/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:41 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:42.652464 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:42.653068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:42.655392 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:42.660616 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:42.661094 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:42.661521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:42.662206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:42.662652 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:42.663066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:42.797024 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:42.804657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b68311d5-565b-42ea-b596-91e9e044dd55 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.156721 Nov 02 20:42:42.805284 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 504/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:42 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:43.828230 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:43.828838 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:43.830775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:43.831432 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:42:43.837351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:43.837827 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:43.838255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:43.839742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:43.840201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:43.840614 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:43.973866 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:43.981878 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bdce2f6f-6525-46ff-a663-63dc92f06e2c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.157533 Nov 02 20:42:43.982426 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 511/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:43 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:45.005415 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:45.005912 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:45.013107 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:45.013585 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:45.014183 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:45.015035 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:45.015662 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:45.016244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:45.154816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:45.162471 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-dc93d056-22c5-4f74-b8bc-45be4b13910e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.160969 Nov 02 20:42:45.163034 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 505/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:45 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:46.186505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:46.187161 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:46.193823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:46.194309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:46.199009 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:46.199875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:46.200342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:46.200943 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:46.345496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:46.353190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5b153f1c-e505-438e-a881-f210b5cb1a19 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.171478 Nov 02 20:42:46.353786 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 512/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:46 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:42:47.376473 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:47.377068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:47.383320 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:47.383849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:47.384280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:47.384969 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:47.386053 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:47.386479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:47.518244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:47.525897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e55e3215-b1d7-45b7-a919-83f0b447920d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.153223 Nov 02 20:42:47.526508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 506/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:47 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:47.694055 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-092457cc-a396-408d-a4f2-2da35803e0df req-6f62c2d1-f2b1-4a0c-8863-af1b19e9c306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88fb0dd-4264-4940-a1d4-7a56d751faad", "name": "network-vif-plugged", "status": "completed", "tag": "bb534f95-1c47-4df0-8a15-827a9f438115"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:42:47.704711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-092457cc-a396-408d-a4f2-2da35803e0df req-6f62c2d1-f2b1-4a0c-8863-af1b19e9c306 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:47.705196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-092457cc-a396-408d-a4f2-2da35803e0df req-6f62c2d1-f2b1-4a0c-8863-af1b19e9c306 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:47.705622 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-092457cc-a396-408d-a4f2-2da35803e0df req-6f62c2d1-f2b1-4a0c-8863-af1b19e9c306 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:47.716654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-092457cc-a396-408d-a4f2-2da35803e0df req-6f62c2d1-f2b1-4a0c-8863-af1b19e9c306 service nova] Creating event network-vif-plugged:bb534f95-1c47-4df0-8a15-827a9f438115 for instance e88fb0dd-4264-4940-a1d4-7a56d751faad on hv-cinder-86236 Nov 02 20:42:47.721524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-092457cc-a396-408d-a4f2-2da35803e0df req-6f62c2d1-f2b1-4a0c-8863-af1b19e9c306 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031604 Nov 02 20:42:47.722426 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 513/1019] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:42:48.548564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:48.549173 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:48.555359 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:48.555871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:48.556303 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:48.556993 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:48.557640 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:48.558063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:48.693436 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:48.702006 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-93c4cdbc-fe4b-437d-b7c5-3b8fea151ce5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.157248 Nov 02 20:42:48.702579 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 507/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:48 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:49.727473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:49.728128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:49.735088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:49.735691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:49.736381 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:49.736933 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:49.737457 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:49.738124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:49.880068 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:49.886037 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e47a4483-2514-4047-9de5-02ed9a035a80 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1264 microversion: 2.1 time: 0.164089 Nov 02 20:42:49.891976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 514/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:49 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:50.909716 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:50.910403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:50.917527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:50.918031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:50.918454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:50.919141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:50.920006 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:50.920470 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:51.054964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:51.063751 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ad076d25-e617-42e5-b207-17a2f978fb66 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1450 microversion: 2.1 time: 0.157850 Nov 02 20:42:51.064321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 508/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:50 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:51.085991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:42:51.086599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:42:51.093747 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:51.094297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:51.094739 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:51.095444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:51.095928 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:51.096376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:51.235255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:42:51.243767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4cebb01b-781f-407e-aec8-d7df200edc21 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1450 microversion: 2.1 time: 0.161587 Nov 02 20:42:51.244532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 515/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:42:51 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:42:53.184856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-24b8fb1b-3e85-4475-9a63-00520398f3a6 req-c295f90a-cdc2-422f-8a19-d9512dd91531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88fb0dd-4264-4940-a1d4-7a56d751faad", "tag": "bb534f95-1c47-4df0-8a15-827a9f438115"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:42:53.199692 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-24b8fb1b-3e85-4475-9a63-00520398f3a6 req-c295f90a-cdc2-422f-8a19-d9512dd91531 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:42:53.200206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-24b8fb1b-3e85-4475-9a63-00520398f3a6 req-c295f90a-cdc2-422f-8a19-d9512dd91531 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:42:53.200655 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-24b8fb1b-3e85-4475-9a63-00520398f3a6 req-c295f90a-cdc2-422f-8a19-d9512dd91531 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:42:53.212454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-24b8fb1b-3e85-4475-9a63-00520398f3a6 req-c295f90a-cdc2-422f-8a19-d9512dd91531 service nova] Creating event network-changed:bb534f95-1c47-4df0-8a15-827a9f438115 for instance e88fb0dd-4264-4940-a1d4-7a56d751faad on hv-cinder-86236 Nov 02 20:42:53.218302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-24b8fb1b-3e85-4475-9a63-00520398f3a6 req-c295f90a-cdc2-422f-8a19-d9512dd91531 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174594 Nov 02 20:42:53.218901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 509/1024] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:43:34.821294 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-48854b69-60f6-4e64-b770-a4ae5db22fa4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Action: 'create', calling method: .version_select at 0x7f2e220bd700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-894966230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIKL6Nqc7/XFluSf78ugQ19uWR1v98omo7e8Px/HS9Dc/7urHYrXtKMHY3ZuyPR6sbITISOgwdrggffhYZFqAJlY1PnkFEdmzIXBeNMbFOCeDhG4ITtPoczG6kG1ubPxw=="}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:43:34.827287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:34.828027 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=54 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:34.840622 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-48854b69-60f6-4e64-b770-a4ae5db22fa4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Getting quotas for project 06b591bcbe15476ab31362d5a6853cce. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:43:34.844410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-48854b69-60f6-4e64-b770-a4ae5db22fa4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Getting quotas for user 2411bcc895994871bc719308e76dbdfb and project 06b591bcbe15476ab31362d5a6853cce. Resources: {'key_pairs'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:43:34.867297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-48854b69-60f6-4e64-b770-a4ae5db22fa4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050756 Nov 02 20:43:34.868028 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 516/1025] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:43:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:43:34.915339 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=24 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:34.916111 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=56 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:34.920478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-73241735", "imageRef": "558e4244-f52a-466e-86bf-495e699210d7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-894966230", "networks": [{"uuid": "08dc5bd3-e169-43d7-a5eb-bf30f8745194"}]}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:43:34.972975 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] validate_networks() for [('08dc5bd3-e169-43d7-a5eb-bf30f8745194', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:43:35.441236 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:43:35.441654 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:43:35.442126 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:43:35.442530 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:43:35.442989 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:43:35.452581 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:35.453051 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:35.453484 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:35.454723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:35.455265 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:35.455710 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:35.472487 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Getting quotas for project 06b591bcbe15476ab31362d5a6853cce. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:43:35.476496 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Getting quotas for user 2411bcc895994871bc719308e76dbdfb and project 06b591bcbe15476ab31362d5a6853cce. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:43:35.487212 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:43:35.489551 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='558e4244-f52a-466e-86bf-495e699210d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:43:35.541104 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-85de0319-f334-44a8-8c72-4e9cfe8caf89 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627325 Nov 02 20:43:35.541750 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 510/1026] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:43:35.553061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3bdfe416-961f-4498-867f-7519fb0b681e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:35.553802 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3bdfe416-961f-4498-867f-7519fb0b681e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:35.608497 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3bdfe416-961f-4498-867f-7519fb0b681e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:35.615729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3bdfe416-961f-4498-867f-7519fb0b681e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1256 microversion: 2.1 time: 0.066687 Nov 02 20:43:35.616300 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 517/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:35 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:36.638264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9e5bff7f-2763-43df-b51a-1315d24914b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:36.638880 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9e5bff7f-2763-43df-b51a-1315d24914b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:36.692599 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9e5bff7f-2763-43df-b51a-1315d24914b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:36.699643 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9e5bff7f-2763-43df-b51a-1315d24914b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1256 microversion: 2.1 time: 0.065286 Nov 02 20:43:36.700197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 511/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:36 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1256 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:37.722103 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ebe2d2c5-bc6d-4e20-b944-c17cdfd8e134 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:37.722714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ebe2d2c5-bc6d-4e20-b944-c17cdfd8e134 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:37.787658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ebe2d2c5-bc6d-4e20-b944-c17cdfd8e134 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:37.794834 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ebe2d2c5-bc6d-4e20-b944-c17cdfd8e134 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1256 microversion: 2.1 time: 0.076599 Nov 02 20:43:37.795475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 518/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:37 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1256 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:38.818986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2cbcb8d9-982a-44af-9291-7dcffdb6d25b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:38.819659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2cbcb8d9-982a-44af-9291-7dcffdb6d25b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:38.873330 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2cbcb8d9-982a-44af-9291-7dcffdb6d25b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:38.881131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2cbcb8d9-982a-44af-9291-7dcffdb6d25b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1256 microversion: 2.1 time: 0.066526 Nov 02 20:43:38.881776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 512/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:38 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:39.904196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:39.904815 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:39.911471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:39.911989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:39.912424 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:39.913117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:39.913574 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:39.913997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:39.976296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:39.983870 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-71f38ee9-23d8-4332-b485-2a580ddedbd1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1260 microversion: 2.1 time: 0.083480 Nov 02 20:43:39.984437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 519/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:39 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1260 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:41.008748 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:41.009906 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:41.022631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:41.023470 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:41.024279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:41.028407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:41.029462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:41.030460 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:41.124232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:41.133618 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-df51efc9-7bfc-46dd-9176-99c295ecf627 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1326 microversion: 2.1 time: 0.131164 Nov 02 20:43:41.134523 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 513/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:41 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:42.157438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:42.158857 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:42.165357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:42.165845 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:42.166279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:42.167012 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:42.167712 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:42.168357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:42.305509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:42.313211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9c559fcb-197b-4da8-9d64-e69c1831f3fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.159618 Nov 02 20:43:42.313774 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 520/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:42 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:43.336108 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:43.336721 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:43.343308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:43.343828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:43.344266 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:43.344962 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:43.345411 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:43.345832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:43.488037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:43.497406 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0af05e72-0b31-4849-a944-42d6017954b9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.165129 Nov 02 20:43:43.497999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 514/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:43 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:44.520171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:44.520928 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:44.528533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:44.529369 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:44.529799 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:44.530496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:44.530939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:44.531352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:44.680760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:44.689072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-563ca66e-5079-4764-b35c-e74c951dcb68 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.172705 Nov 02 20:43:44.689665 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 521/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:44 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:43:45.713513 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:45.714248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:45.716614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:45.722141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:45.722624 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:45.723682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:45.724590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:45.725066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:45.725569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:45.872634 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:45.882458 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b5bf1f2a-4bb2-4bfc-a871-adbb8a35cbd5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.172722 Nov 02 20:43:45.883243 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 515/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:45 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:46.906387 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:46.907035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:46.913681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:46.914159 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:46.914586 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:46.915276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:46.915770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:46.916195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:47.050202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:47.062591 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f90c35e5-e13c-465c-94eb-df8542e73253 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.160075 Nov 02 20:43:47.063171 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 522/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:46 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:48.089517 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:48.092816 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:48.100534 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:48.101049 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:48.101479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:48.102185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:48.102641 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:48.103090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:48.249072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:48.257774 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-47380cdb-9989-4d57-8667-8628c04b44b1 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.175160 Nov 02 20:43:48.258349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 516/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:48 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:49.280763 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:49.281662 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:49.283191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=8 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:49.290276 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:49.290770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:49.291200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:49.291980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:49.292437 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:49.292858 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:49.440354 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:49.448695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9eeab960-fe6c-4643-ab2b-63014b608026 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.171899 Nov 02 20:43:49.449903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 523/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:49 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:43:50.471712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:50.472279 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:50.474055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=10 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:50.479694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:50.480168 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:50.480591 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:50.481272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:50.481717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:50.482131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:50.608905 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:50.616619 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1fed671a-468c-4130-8c45-1360f7dc95b7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.148887 Nov 02 20:43:50.617185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 517/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:50 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:51.639120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:51.639773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:51.646123 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:51.646599 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:51.647033 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:51.647743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:51.648199 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:51.648616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:51.777057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:51.784818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-def599fc-ac12-4beb-91d0-c6952d0ba79e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.149573 Nov 02 20:43:51.785392 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 524/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:51 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:52.808239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:52.808897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:52.815204 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:52.815713 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:52.816154 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:52.816837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:52.817287 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:52.817705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:52.947912 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:52.955659 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a5209df6-9c31-4937-b3a1-bf7bd507549e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.151370 Nov 02 20:43:52.956240 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 518/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:52 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:53.133558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-3fd970f7-8a7c-40e7-8a39-b8bb4d29f845 req-376aa413-07d9-434d-9c1e-d8a8bd1fe5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a62a58-6da4-49df-8f14-2d7a6866226a", "tag": "4bb76c46-6146-4d88-9510-8c820c762742"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:43:53.145646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-3fd970f7-8a7c-40e7-8a39-b8bb4d29f845 req-376aa413-07d9-434d-9c1e-d8a8bd1fe5da service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:53.146880 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-3fd970f7-8a7c-40e7-8a39-b8bb4d29f845 req-376aa413-07d9-434d-9c1e-d8a8bd1fe5da service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:53.147257 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-3fd970f7-8a7c-40e7-8a39-b8bb4d29f845 req-376aa413-07d9-434d-9c1e-d8a8bd1fe5da service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:53.159029 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-3fd970f7-8a7c-40e7-8a39-b8bb4d29f845 req-376aa413-07d9-434d-9c1e-d8a8bd1fe5da service nova] Creating event network-changed:4bb76c46-6146-4d88-9510-8c820c762742 for instance f3a62a58-6da4-49df-8f14-2d7a6866226a on hv-cinder-86236 Nov 02 20:43:53.164741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-3fd970f7-8a7c-40e7-8a39-b8bb4d29f845 req-376aa413-07d9-434d-9c1e-d8a8bd1fe5da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036103 Nov 02 20:43:53.165879 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 525/1043] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:43:53.978727 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:53.979364 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:53.985725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:53.986198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:53.986622 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:53.987296 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:53.987798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:53.988211 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:54.117057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:54.124854 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-33a9b147-966f-4066-b80f-4a352154666c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.150523 Nov 02 20:43:54.125420 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 519/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:53 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:55.148045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:55.148745 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:55.155385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:55.155892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:55.156327 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:55.157018 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:55.157470 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:55.157890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:55.284132 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:55.292327 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cf6df91e-d870-47dc-8a34-38739b73ff1f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.148628 Nov 02 20:43:55.292893 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 526/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:55 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:56.315270 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:56.315906 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:56.323547 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:56.324206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:56.324638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:56.325325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:56.325777 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:56.326196 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:56.454237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:56.462479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-97ce146f-e131-4c75-9d11-3a0ef2e74b0f tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.151041 Nov 02 20:43:56.463058 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 520/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:56 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:57.485084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:57.485717 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:57.492444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:57.492923 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:57.493352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:57.494039 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:57.494489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:57.494909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:57.626552 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:57.634792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bbdac12e-5659-4bf4-9899-81d3a70064a9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.153594 Nov 02 20:43:57.635354 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 527/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:57 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:57.995220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-6f9afa26-d0cd-4715-8418-69152fffe8be req-cf3cc01a-ef3d-4493-87c7-97d29ce7b8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a62a58-6da4-49df-8f14-2d7a6866226a", "name": "network-vif-plugged", "status": "completed", "tag": "4bb76c46-6146-4d88-9510-8c820c762742"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:43:58.007309 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6f9afa26-d0cd-4715-8418-69152fffe8be req-cf3cc01a-ef3d-4493-87c7-97d29ce7b8af service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:58.007831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6f9afa26-d0cd-4715-8418-69152fffe8be req-cf3cc01a-ef3d-4493-87c7-97d29ce7b8af service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:58.008262 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6f9afa26-d0cd-4715-8418-69152fffe8be req-cf3cc01a-ef3d-4493-87c7-97d29ce7b8af service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:58.019478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-6f9afa26-d0cd-4715-8418-69152fffe8be req-cf3cc01a-ef3d-4493-87c7-97d29ce7b8af service nova] Creating event network-vif-plugged:4bb76c46-6146-4d88-9510-8c820c762742 for instance f3a62a58-6da4-49df-8f14-2d7a6866226a on hv-cinder-86236 Nov 02 20:43:58.024776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-6f9afa26-d0cd-4715-8418-69152fffe8be req-cf3cc01a-ef3d-4493-87c7-97d29ce7b8af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Nov 02 20:43:58.025827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 521/1048] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:43:58.658272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:58.658883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:58.665994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:58.666471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:58.666904 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:58.667589 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:58.668137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:58.668557 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:58.801770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:58.809927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-42ac363e-3a39-489d-8ad2-278d1913c7ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.155521 Nov 02 20:43:58.810495 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 528/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:58 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:43:59.833022 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:43:59.834373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:43:59.840968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:59.841447 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:59.841874 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:59.842557 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:43:59.843003 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:43:59.843422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:43:59.978178 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:43:59.985974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a26ac198-8798-4eb0-ab37-44b27fad1b78 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1356 microversion: 2.1 time: 0.157256 Nov 02 20:43:59.986541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 522/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:43:59 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:44:01.008655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:44:01.009172 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:44:01.015558 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.016065 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.016497 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.017181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.017631 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.018053 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.144392 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:44:01.153124 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-98b1160b-578c-4019-acad-5446f968240d tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1545 microversion: 2.1 time: 0.148581 Nov 02 20:44:01.153695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 529/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:44:01 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1545 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:44:01.176015 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:44:01.176621 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:44:01.183267 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.183781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.184209 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.184892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.185337 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.185752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.317132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:44:01.325630 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f2106383-8e29-4653-88be-a9901b153447 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1545 microversion: 2.1 time: 0.153446 Nov 02 20:44:01.326198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 523/1052] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:44:01 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:44:01.347305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:44:01.352039 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:44:01.352802 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Searching by: {'deleted': False, 'project_id': '06b591bcbe15476ab31362d5a6853cce'} {{(pid=118986) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 20:44:01.359190 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.359693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.360128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.360868 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.361313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.361727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.449544 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.multi_cell_list [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118986) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 20:44:01.546624 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f200a72d-c05e-4cc9-9759-ee1f41ed9ac5 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.202823 Nov 02 20:44:01.547094 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 530/1053] 10.222.0.26 () {58 vars in 1125 bytes} [Wed Nov 2 20:44:01 2022] GET /compute/v2.1/servers => generated 341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:44:01.559326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:44:01.559972 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:44:01.565917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.566396 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.566833 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.567526 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:01.568979 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:01.569413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:01.700118 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:44:01.708050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-7f48a425-eff1-40a1-8e49-ab47c05c24ec tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1545 microversion: 2.1 time: 0.152490 Nov 02 20:44:01.708864 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 524/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:44:01 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:44:03.251773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:44:03.254118 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:44:03.261035 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:03.261507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:03.261936 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:03.262618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:03.263072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:03.263482 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:03.535032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c94a5c3f-3086-4e6f-9a4f-7a628ada805a tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286855 Nov 02 20:44:03.535668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 531/1055] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 20:44:03 2022] POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:44:11.142660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:44:11.143268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:44:11.145535 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:44:11.151491 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:11.151995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:11.152435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:11.153122 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:11.153576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:11.154002 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:11.157298 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=71 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:44:11.283648 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:44:11.292064 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-6013a5c2-2bb7-4fd3-98e1-37784c6c306c tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1591 microversion: 2.1 time: 0.153193 Nov 02 20:44:11.292638 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 525/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:44:11 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1591 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:44:12.881008 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-87f0736e-5fd8-483f-b95c-0ca1bc811b6e req-853611f3-a2b7-4ea6-954c-bb3c41d33301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a62a58-6da4-49df-8f14-2d7a6866226a", "tag": "4bb76c46-6146-4d88-9510-8c820c762742"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:44:12.889653 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:44:12.890684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:44:12.898475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-87f0736e-5fd8-483f-b95c-0ca1bc811b6e req-853611f3-a2b7-4ea6-954c-bb3c41d33301 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:12.898965 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-87f0736e-5fd8-483f-b95c-0ca1bc811b6e req-853611f3-a2b7-4ea6-954c-bb3c41d33301 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:12.899395 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-87f0736e-5fd8-483f-b95c-0ca1bc811b6e req-853611f3-a2b7-4ea6-954c-bb3c41d33301 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:12.912597 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:44:12.916199 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-87f0736e-5fd8-483f-b95c-0ca1bc811b6e req-853611f3-a2b7-4ea6-954c-bb3c41d33301 service nova] Creating event network-changed:4bb76c46-6146-4d88-9510-8c820c762742 for instance f3a62a58-6da4-49df-8f14-2d7a6866226a on hv-cinder-86236 Nov 02 20:44:12.921352 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-87f0736e-5fd8-483f-b95c-0ca1bc811b6e req-853611f3-a2b7-4ea6-954c-bb3c41d33301 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044803 Nov 02 20:44:12.921956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 532/1057] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:44:14.088237 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1477643694"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:44:14.088775 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:44:14.095991 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:14.096478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:14.096928 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:14.097623 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:14.098077 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:14.098498 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:14.224140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.network.security_group_api [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Adding security group f7724309-6090-4b64-8adf-448d8fab5e3f to port 4bb76c46-6146-4d88-9510-8c820c762742 Nov 02 20:44:14.562157 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0117542d-6d20-4794-b426-c2b055444b16 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/action" status: 202 len: 0 microversion: 2.1 time: 0.478702 Nov 02 20:44:14.562942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 526/1058] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:44:14 2022] POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:44:14.572957 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:44:14.573652 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:44:14.581385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:14.582313 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:14.582687 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:14.583454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:14.584013 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:14.584414 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:14.731447 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:44:14.739645 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-795acee2-84ae-4494-9111-637ddd6dba70 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1755 microversion: 2.1 time: 0.172208 Nov 02 20:44:14.740227 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 533/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:44:14 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:44:14.937688 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-0f3fd5d4-6bcc-4527-9d38-38323b4ddac7 req-6e629fab-01ef-4488-a2f9-a8d2b1ad93ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a62a58-6da4-49df-8f14-2d7a6866226a", "tag": "4bb76c46-6146-4d88-9510-8c820c762742"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:44:14.947310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-0f3fd5d4-6bcc-4527-9d38-38323b4ddac7 req-6e629fab-01ef-4488-a2f9-a8d2b1ad93ce service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:44:14.947813 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-0f3fd5d4-6bcc-4527-9d38-38323b4ddac7 req-6e629fab-01ef-4488-a2f9-a8d2b1ad93ce service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:44:14.948238 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-0f3fd5d4-6bcc-4527-9d38-38323b4ddac7 req-6e629fab-01ef-4488-a2f9-a8d2b1ad93ce service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:44:14.959020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-0f3fd5d4-6bcc-4527-9d38-38323b4ddac7 req-6e629fab-01ef-4488-a2f9-a8d2b1ad93ce service nova] Creating event network-changed:4bb76c46-6146-4d88-9510-8c820c762742 for instance f3a62a58-6da4-49df-8f14-2d7a6866226a on hv-cinder-86236 Nov 02 20:44:14.964293 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-0f3fd5d4-6bcc-4527-9d38-38323b4ddac7 req-6e629fab-01ef-4488-a2f9-a8d2b1ad93ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030257 Nov 02 20:44:14.965070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 527/1060] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:45:07.454496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:07.455136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:07.457161 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=3 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:07.457795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=7 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:07.459020 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 20:45:07.459204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Wed Nov 2 20:45:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad (ip 10.222.0.26) !!! Nov 02 20:45:07.466886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:07.467362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:07.467824 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:07.468516 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:07.468964 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:07.469383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:07.495199 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:45:07.568741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bf13bea9-84bd-4264-87c1-bdde32c2006e tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 204 len: 0 microversion: 2.1 time: 0.117943 Nov 02 20:45:07.569335 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 534/1061] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:45:07 2022] DELETE /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:45:07.576340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=5 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:07.577538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=11 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:07.584066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:07.584873 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:07.593322 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:07.593800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:07.594232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:07.594922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:07.595378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:07.595829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:07.726420 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:07.734356 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-25bbf9f3-2939-489e-87f0-2067aac90866 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1574 microversion: 2.1 time: 0.160056 Nov 02 20:45:07.734951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 528/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:07 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:08.760198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:08.760897 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:08.767281 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:08.767827 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:08.768270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:08.768961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:08.769413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:08.769837 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:08.901639 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:08.909429 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-212a09d1-9a17-4d84-83ea-d6aca2424995 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1574 microversion: 2.1 time: 0.154141 Nov 02 20:45:08.909998 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 535/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:08 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:09.932829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:09.933426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:09.940007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:09.940658 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:09.941096 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:09.942064 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:09.942549 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:09.942968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:10.006418 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:10.014272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-412ea1dd-408d-435f-813b-23210e00da3a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1507 microversion: 2.1 time: 0.085421 Nov 02 20:45:10.014735 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 529/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:09 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1507 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:10.301947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-0337b9e0-cf6f-44fc-bfe7-86bc1ab429f6 req-471672f5-9776-48bc-bf03-e062b44bc267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88fb0dd-4264-4940-a1d4-7a56d751faad", "name": "network-vif-deleted", "tag": "bb534f95-1c47-4df0-8a15-827a9f438115"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:45:10.314751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-0337b9e0-cf6f-44fc-bfe7-86bc1ab429f6 req-471672f5-9776-48bc-bf03-e062b44bc267 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:10.315228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-0337b9e0-cf6f-44fc-bfe7-86bc1ab429f6 req-471672f5-9776-48bc-bf03-e062b44bc267 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:10.315686 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-0337b9e0-cf6f-44fc-bfe7-86bc1ab429f6 req-471672f5-9776-48bc-bf03-e062b44bc267 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:10.330116 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-0337b9e0-cf6f-44fc-bfe7-86bc1ab429f6 req-471672f5-9776-48bc-bf03-e062b44bc267 service nova] Creating event network-vif-deleted:bb534f95-1c47-4df0-8a15-827a9f438115 for instance e88fb0dd-4264-4940-a1d4-7a56d751faad on hv-cinder-86236 Nov 02 20:45:10.334707 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-0337b9e0-cf6f-44fc-bfe7-86bc1ab429f6 req-471672f5-9776-48bc-bf03-e062b44bc267 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037310 Nov 02 20:45:10.335572 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 536/1065] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:45:11.038644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:11.040465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:11.047372 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:11.047879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:11.048308 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:11.049007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:11.049456 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:11.049871 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:11.082644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:11.083130 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:11.083564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:11.084033 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lazy-loading 'fault' on Instance uuid e88fb0dd-4264-4940-a1d4-7a56d751faad {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:45:11.132954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:11.140883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a5484290-60a1-4f31-a19c-b4f6dbc54107 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 200 len: 1229 microversion: 2.1 time: 0.106523 Nov 02 20:45:11.141603 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 530/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:11 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:12.165070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:12.165759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:12.171844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:12.172324 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:12.172787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:12.173475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:12.173926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:12.174357 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:12.187711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] HTTP exception thrown: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Request method failure captured: Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad HTTP/1.1 Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtYOdPsra39htrmk_FHmEmjN98hd71w_tV_RxcMVko9hz4jDeSsrZOBSl0vZJ0xj8NUBD_FOMeIwgrvfb4G01HtPLFsmGqLSBWTfoPs4tIieiYKmmvyVhDlXpGt56WKeZPH-QOT3tWo75MC7ryRmYfcYNGAWxLvQx1z5mlnixlJKGdU Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 02f491b87b30459495465d90dece762c Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:45:12.189305 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02f491b87b30459495465d90dece762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02f491b87b30459495465d90dece762c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}] Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-TestVolumeBootPattern-102500767 Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 02f491b87b30459495465d90dece762c Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: d128e7c1d70c41c29e5ac77d59378fac Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:45:12.190980 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'e88fb0dd-4264-4940-a1d4-7a56d751faad'} Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:45:12.191929 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:45:12.193255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:45:12.194452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Returning 404 to user: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:45:12.194452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e09827f8-5e86-48d2-bbf8-9c7f00f8b4a6 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 404 len: 111 microversion: 2.1 time: 0.030340 Nov 02 20:45:12.194452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 537/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:12 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:45:12.287240 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1509885153", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1643622842", "security_groups": [{"name": "tempest-secgroup-smoke-957565563"}], "block_device_mapping_v2": [{"uuid": "e2bf28b1-f298-4a81-8d48-dbc18cc9fb7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7606db48-5c2f-421e-bbd0-08f46d425024"}]}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:45:12.400685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.network.neutron [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] validate_networks() for [('7606db48-5c2f-421e-bbd0-08f46d425024', None, None, None, None, None)] {{(pid=118985) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:45:12.760375 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Flavor limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:45:12.760791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Image limits 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:45:12.761258 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Flavor pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:45:12.761656 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Image pref 0:0:0 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:45:12.762059 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.virt.hardware [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:45:12.770629 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:12.771110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:12.771534 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:12.772303 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:12.772753 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:12.773171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:12.791076 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for project 02f491b87b30459495465d90dece762c. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:45:12.794970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for user d128e7c1d70c41c29e5ac77d59378fac and project 02f491b87b30459495465d90dece762c. Resources: {'instances', 'cores', 'ram'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:45:12.851281 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Going to run 1 instances... {{(pid=118985) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:45:12.854043 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e2bf28b1-f298-4a81-8d48-dbc18cc9fb7f',volume_size=None,volume_type=None)] {{(pid=118985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:45:12.984282 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8199aee3-dc81-4fe1-8aee-ea45b3565e76 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700791 Nov 02 20:45:12.984965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 531/1068] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:45:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:45:12.996074 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-3a66f19a-68b4-46cb-aa5a-7899fb30a2bb tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:12.996693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-3a66f19a-68b4-46cb-aa5a-7899fb30a2bb tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:13.054380 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-3a66f19a-68b4-46cb-aa5a-7899fb30a2bb tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:13.062165 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-3a66f19a-68b4-46cb-aa5a-7899fb30a2bb tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1095 microversion: 2.1 time: 0.070124 Nov 02 20:45:13.062728 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 538/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:12 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:13.506153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:45:13.509244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:13.515321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:13.515826 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:13.516255 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:13.516940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:13.517386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:13.517801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:13.588799 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d9f8ef74-afbe-48e8-943c-dd7ddeefba23 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/action" status: 202 len: 0 microversion: 2.1 time: 0.086845 Nov 02 20:45:13.589426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 532/1070] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:45:13 2022] POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:45:13.597388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:13.598003 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:13.605576 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:13.606036 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:13.606514 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:13.607285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:13.607832 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:13.608266 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:13.812240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:13.820455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c65a8993-7076-4124-b478-50c42d66fb2b tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1747 microversion: 2.1 time: 0.226912 Nov 02 20:45:13.821804 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 539/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:13 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1747 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:14.087373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-18b3c3a2-8411-4946-9326-ab905edd6ac7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:14.088379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-18b3c3a2-8411-4946-9326-ab905edd6ac7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:14.275604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-18b3c3a2-8411-4946-9326-ab905edd6ac7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:14.282451 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-18b3c3a2-8411-4946-9326-ab905edd6ac7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1095 microversion: 2.1 time: 0.200936 Nov 02 20:45:14.283005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 533/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:14 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1095 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:14.845103 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:14.845642 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:14.852202 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:14.852698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:14.853122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:14.853802 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:14.854247 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:14.854660 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:15.044235 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:15.052406 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-63e09d34-992c-429b-a3c4-7b1d5f88a394 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.211195 Nov 02 20:45:15.052970 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 540/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:14 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:15.304667 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-38fef7bb-f3f0-4392-82cb-b152e5aaf76f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:15.305935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-38fef7bb-f3f0-4392-82cb-b152e5aaf76f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:15.360811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-38fef7bb-f3f0-4392-82cb-b152e5aaf76f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:15.368347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-38fef7bb-f3f0-4392-82cb-b152e5aaf76f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1095 microversion: 2.1 time: 0.066904 Nov 02 20:45:15.369120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 534/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:15 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:16.077196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:16.077805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:16.084350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:16.084831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:16.085264 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:16.085958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:16.086410 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:16.086860 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:16.226457 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:16.234718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7feaa6b4-0842-4a07-8364-174bd2afd4fb tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.161419 Nov 02 20:45:16.235283 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 541/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:16 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:16.391097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:16.391729 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:16.398206 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:16.398683 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:16.399110 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:16.400459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:16.400929 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:16.401347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:16.466987 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:16.474700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5cf72f2e-b242-4188-8559-7f4981dd443b tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1145 microversion: 2.1 time: 0.087467 Nov 02 20:45:16.475267 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 535/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:16 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:17.259722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:17.260806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:17.267501 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:17.268073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:17.268612 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:17.269282 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:17.269737 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:17.270297 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:17.499262 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:17.499910 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:17.506361 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:17.506942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:17.507439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:17.508369 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:17.508825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:17.510050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:17.518392 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:17.528222 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e622a1ba-7cbb-4815-b452-76d7cfde8387 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.273583 Nov 02 20:45:17.541718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 542/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:17 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:17.591671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:17.600248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2e046969-4349-4089-91a5-d4bb34a11b4d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1211 microversion: 2.1 time: 0.104946 Nov 02 20:45:17.601452 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 536/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:17 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:18.554477 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:18.554942 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:18.561215 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:18.561705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:18.562150 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:18.562850 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:18.563302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:18.563758 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:18.624061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:18.625456 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:18.632198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:18.632709 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:18.633138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:18.633837 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:18.634785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:18.635199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:18.776158 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:18.783821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-79b08323-f817-494e-a028-efdaaf000ee5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.165369 Nov 02 20:45:18.784389 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 537/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:18 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:18.793849 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:18.802046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-1ec6558c-551e-4420-ad7f-8b439d4e14d4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.251635 Nov 02 20:45:18.802621 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 543/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:18 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:19.060943 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-ea1c6e70-0aa2-4f49-82b0-46df28223fd4 req-9b1ffcde-5968-412b-a5ee-b6739c8934ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c4e1a0-2cf5-4a94-a7b9-872748160fe4", "tag": "5761d096-ea48-406b-aa4a-e24ad6d9213c"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:45:19.070507 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-ea1c6e70-0aa2-4f49-82b0-46df28223fd4 req-9b1ffcde-5968-412b-a5ee-b6739c8934ee service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:19.071239 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-ea1c6e70-0aa2-4f49-82b0-46df28223fd4 req-9b1ffcde-5968-412b-a5ee-b6739c8934ee service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:19.072225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-ea1c6e70-0aa2-4f49-82b0-46df28223fd4 req-9b1ffcde-5968-412b-a5ee-b6739c8934ee service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:19.083021 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-ea1c6e70-0aa2-4f49-82b0-46df28223fd4 req-9b1ffcde-5968-412b-a5ee-b6739c8934ee service nova] Creating event network-changed:5761d096-ea48-406b-aa4a-e24ad6d9213c for instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 on hv-cinder-86236 Nov 02 20:45:19.088622 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-ea1c6e70-0aa2-4f49-82b0-46df28223fd4 req-9b1ffcde-5968-412b-a5ee-b6739c8934ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038207 Nov 02 20:45:19.089386 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 538/1081] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:45:19.806593 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:19.807154 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:19.813458 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:19.813934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:19.814361 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:19.815045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:19.815496 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:19.815938 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:19.826560 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:19.827254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:19.833318 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:19.833772 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:19.834198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:19.834878 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:19.835324 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:19.835764 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:19.952302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:19.960006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c2f9d73f-edc4-44a3-90f7-3f0d43728920 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.157978 Nov 02 20:45:19.960580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 544/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:19 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:19.981578 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:19.989961 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a9d137e2-52ff-4f60-9d8d-89eb091271a2 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.167998 Nov 02 20:45:19.990534 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 539/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:19 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:20.983211 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:20.983783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:20.990100 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:20.990587 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:20.991021 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:20.991738 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:20.992196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:20.992618 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:21.014037 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:21.014660 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:21.021229 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:21.021713 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:21.022145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:21.022844 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:21.023297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:21.023744 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:21.167807 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:21.175932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-68acc9c7-e9d1-4566-b097-438db3521542 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.165700 Nov 02 20:45:21.176508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 540/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:21 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:21.233427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:21.241185 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9cce54d8-44c3-4953-9df0-f1f77bb7e756 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.261912 Nov 02 20:45:21.241892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 545/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:20 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:22.200430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:22.201032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:22.207373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:22.207870 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:22.208297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:22.208971 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:22.209416 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:22.209831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:22.265060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:22.265667 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:22.272061 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:22.272541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:22.272970 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:22.273658 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:22.274130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:22.275234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:22.351493 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:22.359601 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5f71b64c-22df-41dd-a6e3-8b482ddad3c7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.163870 Nov 02 20:45:22.360314 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 541/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:22 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:22.405586 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:22.413177 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c5ca092f-f5cf-41e4-91b1-168ba24cfde9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.152014 Nov 02 20:45:22.413757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 546/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:22 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:23.383285 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:23.383951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:23.385868 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:23.391604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:23.392101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:23.392522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:23.393202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:23.393650 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:23.394064 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:23.436544 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:23.437161 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:23.439140 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:23.445087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:23.445578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:23.446270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:23.447084 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:23.447542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:23.447993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:23.539132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:23.548125 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-85b749a7-8ae8-42c9-b276-c31190e2e572 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.168602 Nov 02 20:45:23.548709 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 542/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:23 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:23.583996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:23.593771 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e5d7e09d-23de-4878-ad7a-d4f27d32d0e5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.161418 Nov 02 20:45:23.594342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 547/1089] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:23 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:24.571902 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:24.572504 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:24.578828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:24.579300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:24.579766 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:24.580443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:24.580886 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:24.581297 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:24.616764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:24.617379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:24.624572 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:24.625062 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:24.625501 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:24.626203 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:24.626688 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:24.627113 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:24.726892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:24.734819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5fef7fdb-d2cb-4eed-bf89-f2ba3433086e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1752 microversion: 2.1 time: 0.166622 Nov 02 20:45:24.735244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 543/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:24 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:24.757945 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:24.765609 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-69a81b36-71a5-4103-9c00-742c38e89edd tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.152686 Nov 02 20:45:24.766176 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 548/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:24 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:25.756700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:25.757313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:25.759830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=10 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:25.765674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:25.766152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:25.766574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:25.767255 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:25.767726 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:25.768145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:25.788725 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:25.789367 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:25.796348 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:25.796830 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:25.797266 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:25.797963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:25.798422 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:25.798851 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:25.912620 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:25.921508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-988cc49c-aab3-4160-b3a2-f26b69d98667 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1755 microversion: 2.1 time: 0.168674 Nov 02 20:45:25.922079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 544/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:25 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:25.933435 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:25.941086 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cf40790b-298a-4dfb-bc7e-28b6d58c2608 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.156220 Nov 02 20:45:25.941645 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 549/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:25 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:45:26.963769 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:26.964379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:26.970817 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:26.971299 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:26.971753 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:26.972439 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:26.972892 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:26.973307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:27.100063 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:27.107821 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-422c9d15-7217-49d0-9efc-5a78e32fd163 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.147900 Nov 02 20:45:27.108416 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 545/1094] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:26 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:28.130390 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:28.130995 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:28.138026 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:28.138498 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:28.138937 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:28.139701 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:28.140089 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:28.140502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:28.272953 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:28.281249 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0fd82533-0bd0-430b-a881-554652c507ac tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.154746 Nov 02 20:45:28.281825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 550/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:28 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:29.304046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:29.304657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:29.311147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:29.311639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:29.312079 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:29.312758 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:29.313202 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:29.313617 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:29.331477 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:29.445752 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:29.453785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-649953ed-b74e-4446-8a72-38412bf6434a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.153578 Nov 02 20:45:29.454355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 546/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:29 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:30.376865 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-a936a7c9-3689-4705-bfe0-0f45af7abcc6 req-7a376576-9ef2-4113-b565-ec5bb8d2192e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c4e1a0-2cf5-4a94-a7b9-872748160fe4", "name": "network-vif-plugged", "status": "completed", "tag": "5761d096-ea48-406b-aa4a-e24ad6d9213c"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:45:30.386892 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a936a7c9-3689-4705-bfe0-0f45af7abcc6 req-7a376576-9ef2-4113-b565-ec5bb8d2192e service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:30.387356 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a936a7c9-3689-4705-bfe0-0f45af7abcc6 req-7a376576-9ef2-4113-b565-ec5bb8d2192e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:30.387883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-a936a7c9-3689-4705-bfe0-0f45af7abcc6 req-7a376576-9ef2-4113-b565-ec5bb8d2192e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:30.391963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:45:30.399723 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-a936a7c9-3689-4705-bfe0-0f45af7abcc6 req-7a376576-9ef2-4113-b565-ec5bb8d2192e service nova] Creating event network-vif-plugged:5761d096-ea48-406b-aa4a-e24ad6d9213c for instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 on hv-cinder-86236 Nov 02 20:45:30.404705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-a936a7c9-3689-4705-bfe0-0f45af7abcc6 req-7a376576-9ef2-4113-b565-ec5bb8d2192e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031475 Nov 02 20:45:30.405345 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 551/1097] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:45:30.478052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:30.479901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:30.486745 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:30.487221 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:30.487671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:30.488360 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:30.488806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:30.489224 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:30.623737 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:30.631359 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-eff2cdd3-ca9e-47d5-ad91-250908898654 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.158501 Nov 02 20:45:30.631959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 547/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:30 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:31.656320 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:31.657010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:31.663760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:31.664234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:31.664659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:31.665338 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:31.665785 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:31.666200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:31.801022 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:31.809418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-f7d429e9-ce20-4b9d-a7da-70c3eab2117f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1266 microversion: 2.1 time: 0.158061 Nov 02 20:45:31.809927 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 552/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:31 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:32.832516 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:32.833131 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:32.839808 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:32.840288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:32.840721 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:32.841404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:32.841855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:32.842274 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:32.971429 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:32.979254 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9df4a936-0ef8-40e2-8209-c0f0730a8e3c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1453 microversion: 2.1 time: 0.150648 Nov 02 20:45:32.980017 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 548/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:32 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:33.001799 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:45:33.002408 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:45:33.008795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:33.009272 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:33.009702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:33.011003 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:33.011455 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:33.011906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:33.140483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:45:33.148169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b649b521-52b2-464b-85c1-ae720c9ebd70 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1453 microversion: 2.1 time: 0.150154 Nov 02 20:45:33.148738 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 553/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:45:32 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:45:34.708399 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-6450f6f3-8422-4adc-ad67-72105f3a9bd2 req-7dd890d8-2b7d-4e5e-949f-e4f5add26b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c4e1a0-2cf5-4a94-a7b9-872748160fe4", "tag": "5761d096-ea48-406b-aa4a-e24ad6d9213c"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:45:34.718990 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6450f6f3-8422-4adc-ad67-72105f3a9bd2 req-7dd890d8-2b7d-4e5e-949f-e4f5add26b9a service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:45:34.719469 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6450f6f3-8422-4adc-ad67-72105f3a9bd2 req-7dd890d8-2b7d-4e5e-949f-e4f5add26b9a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:45:34.719932 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-6450f6f3-8422-4adc-ad67-72105f3a9bd2 req-7dd890d8-2b7d-4e5e-949f-e4f5add26b9a service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:45:34.740364 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-6450f6f3-8422-4adc-ad67-72105f3a9bd2 req-7dd890d8-2b7d-4e5e-949f-e4f5add26b9a service nova] Creating event network-changed:5761d096-ea48-406b-aa4a-e24ad6d9213c for instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 on hv-cinder-86236 Nov 02 20:45:34.745632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-6450f6f3-8422-4adc-ad67-72105f3a9bd2 req-7dd890d8-2b7d-4e5e-949f-e4f5add26b9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040766 Nov 02 20:45:34.746689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 549/1102] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:46:29.272917 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1477643694"}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:46:29.273551 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:29.275573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:46:29.276241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=12 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:46:29.282311 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:29.282787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:29.283213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:29.283931 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:29.284378 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:29.284794 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:29.412608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.network.security_group_api [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Removing security group f7724309-6090-4b64-8adf-448d8fab5e3f from port 4bb76c46-6146-4d88-9510-8c820c762742 Nov 02 20:46:29.707367 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bbb5c625-c844-448e-92f1-aa1c750076f9 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/action" status: 202 len: 0 microversion: 2.1 time: 0.438543 Nov 02 20:46:29.708095 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 554/1103] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:46:29 2022] POST /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:46:29.720545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:46:29.721270 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=16 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:46:29.722655 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 20:46:29.723049 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Wed Nov 2 20:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Nov 02 20:46:29.796102 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-498cae1e-8f0a-4e9b-9208-cb31d22fc582 req-caceae98-4517-4247-aa89-7b917314849c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a62a58-6da4-49df-8f14-2d7a6866226a", "tag": "4bb76c46-6146-4d88-9510-8c820c762742"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:46:29.808722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-498cae1e-8f0a-4e9b-9208-cb31d22fc582 req-caceae98-4517-4247-aa89-7b917314849c service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:29.809288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-498cae1e-8f0a-4e9b-9208-cb31d22fc582 req-caceae98-4517-4247-aa89-7b917314849c service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:29.809898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-498cae1e-8f0a-4e9b-9208-cb31d22fc582 req-caceae98-4517-4247-aa89-7b917314849c service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:29.822674 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-498cae1e-8f0a-4e9b-9208-cb31d22fc582 req-caceae98-4517-4247-aa89-7b917314849c service nova] Creating event network-changed:4bb76c46-6146-4d88-9510-8c820c762742 for instance f3a62a58-6da4-49df-8f14-2d7a6866226a on hv-cinder-86236 Nov 02 20:46:29.828377 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-498cae1e-8f0a-4e9b-9208-cb31d22fc582 req-caceae98-4517-4247-aa89-7b917314849c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112763 Nov 02 20:46:29.829147 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 550/1104] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:46:30.987019 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:30.987491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:30.991427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-2da6ffeb-55bf-4ce1-9a6f-c876f06377e0 req-a74ab883-4ed2-4e12-8744-b25c1f29c135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a62a58-6da4-49df-8f14-2d7a6866226a", "tag": "4bb76c46-6146-4d88-9510-8c820c762742"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:46:30.994426 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:30.994934 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:30.995798 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:30.996730 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:30.997363 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:30.997790 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:31.002790 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-2da6ffeb-55bf-4ce1-9a6f-c876f06377e0 req-a74ab883-4ed2-4e12-8744-b25c1f29c135 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:31.003350 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-2da6ffeb-55bf-4ce1-9a6f-c876f06377e0 req-a74ab883-4ed2-4e12-8744-b25c1f29c135 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:31.004880 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-2da6ffeb-55bf-4ce1-9a6f-c876f06377e0 req-a74ab883-4ed2-4e12-8744-b25c1f29c135 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:31.017436 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-2da6ffeb-55bf-4ce1-9a6f-c876f06377e0 req-a74ab883-4ed2-4e12-8744-b25c1f29c135 service nova] Creating event network-changed:4bb76c46-6146-4d88-9510-8c820c762742 for instance f3a62a58-6da4-49df-8f14-2d7a6866226a on hv-cinder-86236 Nov 02 20:46:31.022680 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-2da6ffeb-55bf-4ce1-9a6f-c876f06377e0 req-a74ab883-4ed2-4e12-8744-b25c1f29c135 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036956 Nov 02 20:46:31.023454 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 551/1105] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:46:31.082894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.objects.instance [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lazy-loading 'services' on Instance uuid f3a62a58-6da4-49df-8f14-2d7a6866226a {{(pid=118986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:46:31.165729 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-95b9738a-0c60-4100-bbdd-b0ec69ae5507 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments/ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c" status: 202 len: 0 microversion: 2.1 time: 0.182789 Nov 02 20:46:31.167007 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 555/1106] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:46:30 2022] DELETE /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments/ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:46:31.183232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:31.187208 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:31.198174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:31.199694 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:31.200690 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:31.201632 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:31.202796 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:31.203242 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:31.242673 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-73c12d43-09b0-494f-beef-f679425716a4 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065555 Nov 02 20:46:31.243911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 552/1107] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:46:31 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:46:32.257543 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:32.259910 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:32.266909 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:32.267388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:32.267914 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:32.269773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:32.270237 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:32.270659 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:32.298805 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8c264d78-fc6e-4ed5-8506-bba3ca31b0dd tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046086 Nov 02 20:46:32.299363 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 556/1108] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 20:46:32 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 20:46:32.310671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:32.311161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:32.317248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:32.317723 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:32.318151 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:32.318828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:32.319278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:32.319719 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:32.394105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] HTTP exception thrown: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a is not attached to volume ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Request method failure captured: Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments/ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c HTTP/1.1 Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtZoYvExhUY1DkoaEInCvbwXTkWsw-w0Rv23Tj1UQOE2HdZoRO-UwjNEBvEzi-yIzCTEc-hzxxVTSRwRjqaNp9-O8PjgYN-6VQ68Ep8SzaHdgFn5JGDJFeVgsciZMa6zq42VAZXV9Chx0QQ3g1JwxOFL4ZMXv9vS6rdTOry69pKOkVI Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 06b591bcbe15476ab31362d5a6853cce Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-TestMinimumBasicScenario-1978330734 Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:46:32.398571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06b591bcbe15476ab31362d5a6853cce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06b591bcbe15476ab31362d5a6853cce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06b591bcbe15476ab31362d5a6853cce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06b591bcbe15476ab31362d5a6853cce"}]}] Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-TestMinimumBasicScenario-1978330734 Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 06b591bcbe15476ab31362d5a6853cce Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1978330734 Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-TestMinimumBasicScenario-1978330734-project Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 2411bcc895994871bc719308e76dbdfb Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-TestMinimumBasicScenario-1978330734-project Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:46:32.400365 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a is not attached to volume ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'server_id': 'f3a62a58-6da4-49df-8f14-2d7a6866226a', 'id': 'ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c'} Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c. Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:46:32.401272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a is not attached to volume ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a is not attached to volume ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:32.402836 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Returning 404 to user: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a is not attached to volume ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:46:32.404047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-efe35977-473c-4c26-b36e-d7010289ee2e tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments/ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c" status: 404 len: 154 microversion: 2.1 time: 0.094496 Nov 02 20:46:32.404047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 553/1109] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 20:46:32 2022] DELETE /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a/os-volume_attachments/ecca2e5e-89f1-49f2-b3ae-d15b7f8c4e1c => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:46:33.541673 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:33.542161 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:33.548591 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:33.549073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:33.549508 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:33.550195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:33.550646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:33.551067 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:33.576075 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:46:33.652668 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-2e934217-1c5f-4e6d-a2b2-d3a6f7932289 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 204 len: 0 microversion: 2.1 time: 0.114486 Nov 02 20:46:33.653376 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 557/1110] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:46:33 2022] DELETE /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:46:33.661986 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:33.662597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:33.668957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:33.669438 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:33.669867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:33.670553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:33.671007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:33.671433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:33.802246 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:46:33.810491 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-092bc32e-6359-4bb6-806b-f0a57bd22489 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1551 microversion: 2.1 time: 0.152397 Nov 02 20:46:33.811057 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 554/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:46:33 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:46:34.835106 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:34.835836 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:34.842708 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:34.843216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:34.843675 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:34.844367 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:34.844818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:34.845238 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:35.233918 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:46:35.242187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-31af04bc-c099-4180-b68f-57c5900a3ea0 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1551 microversion: 2.1 time: 0.411387 Nov 02 20:46:35.242750 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 558/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:46:34 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1551 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:46:36.266264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:36.266832 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:36.273354 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:36.273830 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:36.274258 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:36.274942 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:36.275440 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:36.275901 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:36.345029 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2411bcc895994871bc719308e76dbdfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b591bcbe15476ab31362d5a6853cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:46:36.358484 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-fc011ee8-b33d-4062-9dca-db4025ea1ea8 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 200 len: 1509 microversion: 2.1 time: 0.096138 Nov 02 20:46:36.359074 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 555/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:46:36 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 1509 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:46:36.369819 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-567be2fe-8cb8-4fc9-ac4c-b3a27f9f1fe7 req-6cf6d657-35b9-4888-99dd-86acad45cd08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a62a58-6da4-49df-8f14-2d7a6866226a", "name": "network-vif-deleted", "tag": "4bb76c46-6146-4d88-9510-8c820c762742"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:46:36.381296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-567be2fe-8cb8-4fc9-ac4c-b3a27f9f1fe7 req-6cf6d657-35b9-4888-99dd-86acad45cd08 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:36.381764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-567be2fe-8cb8-4fc9-ac4c-b3a27f9f1fe7 req-6cf6d657-35b9-4888-99dd-86acad45cd08 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:36.382187 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-567be2fe-8cb8-4fc9-ac4c-b3a27f9f1fe7 req-6cf6d657-35b9-4888-99dd-86acad45cd08 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:36.393822 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-567be2fe-8cb8-4fc9-ac4c-b3a27f9f1fe7 req-6cf6d657-35b9-4888-99dd-86acad45cd08 service nova] Creating event network-vif-deleted:4bb76c46-6146-4d88-9510-8c820c762742 for instance f3a62a58-6da4-49df-8f14-2d7a6866226a on hv-cinder-86236 Nov 02 20:46:36.398941 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-567be2fe-8cb8-4fc9-ac4c-b3a27f9f1fe7 req-6cf6d657-35b9-4888-99dd-86acad45cd08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032668 Nov 02 20:46:36.399530 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 559/1114] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:46:37.381112 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:37.381731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [instance: f3a62a58-6da4-49df-8f14-2d7a6866226a] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:46:37.389430 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:37.389917 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:37.390352 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:37.391046 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:46:37.391499 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:46:37.391951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:46:37.405628 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] HTTP exception thrown: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a could not be found. Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Request method failure captured: Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a HTTP/1.1 Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtZoYvExhUY1DkoaEInCvbwXTkWsw-w0Rv23Tj1UQOE2HdZoRO-UwjNEBvEzi-yIzCTEc-hzxxVTSRwRjqaNp9-O8PjgYN-6VQ68Ep8SzaHdgFn5JGDJFeVgsciZMa6zq42VAZXV9Chx0QQ3g1JwxOFL4ZMXv9vS6rdTOry69pKOkVI Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 06b591bcbe15476ab31362d5a6853cce Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-TestMinimumBasicScenario-1978330734 Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:46:37.407141 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06b591bcbe15476ab31362d5a6853cce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06b591bcbe15476ab31362d5a6853cce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06b591bcbe15476ab31362d5a6853cce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06b591bcbe15476ab31362d5a6853cce"}]}] Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-TestMinimumBasicScenario-1978330734 Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 06b591bcbe15476ab31362d5a6853cce Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1978330734 Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-TestMinimumBasicScenario-1978330734-project Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: 2411bcc895994871bc719308e76dbdfb Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-TestMinimumBasicScenario-1978330734-project Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a could not be found. Nov 02 20:46:37.408797 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'f3a62a58-6da4-49df-8f14-2d7a6866226a'} Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a could not be found. Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:46:37.409831 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a could not be found. Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a could not be found. Nov 02 20:46:37.411368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:46:37.412859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Returning 404 to user: Instance f3a62a58-6da4-49df-8f14-2d7a6866226a could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:46:37.412859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4374ae30-c13b-49b8-8c20-3ce24b947367 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a" status: 404 len: 111 microversion: 2.1 time: 0.031333 Nov 02 20:46:37.412859 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 556/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:46:37 2022] GET /compute/v2.1/servers/f3a62a58-6da4-49df-8f14-2d7a6866226a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:46:37.418698 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-6398b3e9-c922-4fd4-b34e-4f07206675a7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] Calling method '.version_select at 0x7f2e222f99d0>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:46:37.423863 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6398b3e9-c922-4fd4-b34e-4f07206675a7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [29c86655-e3cd-4a84-9f97-652ff42a838a] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 20:46:38.431157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO oslo.messaging._drivers.impl_rabbit [None req-6398b3e9-c922-4fd4-b34e-4f07206675a7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] [29c86655-e3cd-4a84-9f97-652ff42a838a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 58770. Nov 02 20:46:38.452400 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-6398b3e9-c922-4fd4-b34e-4f07206675a7 tempest-TestMinimumBasicScenario-1978330734 tempest-TestMinimumBasicScenario-1978330734-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-894966230" status: 202 len: 0 microversion: 2.1 time: 1.038875 Nov 02 20:46:38.452961 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 560/1116] 10.222.0.26 () {58 vars in 1269 bytes} [Wed Nov 2 20:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-894966230 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 20:46:55.692965 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=14 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:46:55.694185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=30 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:46:55.891829 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0da95f19-6be5-4961-bcfc-1562cfff646c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Action: 'create', calling method: .version_select at 0x7f2e222ddc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-958206346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU7drWFepC+fH1pWPHUACinKjUPi6W+roTldYHsQEJEovq+V3mg+D3RZS/fYli/c6mxrGGcbgpw8vRc0T1ulk3gHIasDlG8V0b0JweFbwF0MqNnuXJm2p+GBSonF7iMzA=="}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:46:55.908706 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-0da95f19-6be5-4961-bcfc-1562cfff646c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Getting quotas for project 05738aea94f0499a99582c6458880dbd. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:46:55.912888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.quota [None req-0da95f19-6be5-4961-bcfc-1562cfff646c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Getting quotas for user 4955b7580d544cfb91c44b8d4c6758dd and project 05738aea94f0499a99582c6458880dbd. Resources: {'key_pairs'} {{(pid=118985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:46:55.944363 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0da95f19-6be5-4961-bcfc-1562cfff646c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.258814 Nov 02 20:46:55.944966 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 557/1117] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 20:46:55 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:47:17.673894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:17.675178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:17.679442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1600330115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-958206346", "security_groups": [{"name": "tempest-secgroup-smoke-892480559"}], "networks": [{"uuid": "5bf049ad-193c-4f9c-a77f-5eb70ffb8b2d"}], "block_device_mapping_v2": [{"uuid": "a3c8a761-3451-4701-b984-fa8b84193c6e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:17.793531 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] validate_networks() for [('5bf049ad-193c-4f9c-a77f-5eb70ffb8b2d', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:47:18.162301 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:47:18.162754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:47:18.163226 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:47:18.163655 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:47:18.164072 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:47:18.173883 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:18.174361 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:18.174822 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:18.175575 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:18.176046 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:18.176465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:18.192726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Getting quotas for project 05738aea94f0499a99582c6458880dbd. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:47:18.196580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Getting quotas for user 4955b7580d544cfb91c44b8d4c6758dd and project 05738aea94f0499a99582c6458880dbd. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:47:18.252958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:47:18.255196 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3c8a761-3451-4701-b984-fa8b84193c6e',volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:47:18.382379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-34b76116-85a6-44d9-8b48-2dfb7fed9857 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709938 Nov 02 20:47:18.383020 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 561/1118] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:47:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 20:47:18.392132 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=4 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:18.392872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:18.397026 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e141d3df-a77e-45d8-be10-0fc06fdc5f9b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:18.397646 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e141d3df-a77e-45d8-be10-0fc06fdc5f9b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:18.452872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e141d3df-a77e-45d8-be10-0fc06fdc5f9b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:18.459741 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e141d3df-a77e-45d8-be10-0fc06fdc5f9b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1088 microversion: 2.1 time: 0.068857 Nov 02 20:47:18.460705 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 558/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:18 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:19.484303 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:19.484902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:19.491054 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:19.491537 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:19.491994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:19.492691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:19.493145 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:19.493567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:19.570865 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:19.579703 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a01b2c2f-4714-4897-9757-0cbbc37eeedf tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1186 microversion: 2.1 time: 0.100065 Nov 02 20:47:19.595292 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 562/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:19 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1186 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:20.603273 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:20.603843 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:20.611373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:20.611884 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:20.612313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:20.612997 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:20.613444 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:20.613856 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:20.747336 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:20.755197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bddc7df2-bb07-4983-a248-ef41a24b29ad tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.156036 Nov 02 20:47:20.756020 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 559/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:20 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:20.970379 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-d38d5362-7388-4003-b5f4-a962d82352cf req-5592780d-5e20-4aa0-9c4d-e7ce9efebc9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76332b41-4b20-4056-a012-0ff87d99138c", "tag": "7ca48e17-28e4-419c-89e6-7f1b2d459420"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:20.981742 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d38d5362-7388-4003-b5f4-a962d82352cf req-5592780d-5e20-4aa0-9c4d-e7ce9efebc9f service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:20.982210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d38d5362-7388-4003-b5f4-a962d82352cf req-5592780d-5e20-4aa0-9c4d-e7ce9efebc9f service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:20.982779 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-d38d5362-7388-4003-b5f4-a962d82352cf req-5592780d-5e20-4aa0-9c4d-e7ce9efebc9f service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:20.994183 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-d38d5362-7388-4003-b5f4-a962d82352cf req-5592780d-5e20-4aa0-9c4d-e7ce9efebc9f service nova] Creating event network-changed:7ca48e17-28e4-419c-89e6-7f1b2d459420 for instance 76332b41-4b20-4056-a012-0ff87d99138c on hv-cinder-86236 Nov 02 20:47:20.999101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-d38d5362-7388-4003-b5f4-a962d82352cf req-5592780d-5e20-4aa0-9c4d-e7ce9efebc9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Nov 02 20:47:20.999721 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 563/1122] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:47:21.781152 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:21.782072 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:21.788508 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:21.788995 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:21.789450 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:21.790138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:21.790590 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:21.791008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:21.922221 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:21.929791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-5408a92f-4d5c-4ef5-9f58-f70a0f1b9bf4 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.154936 Nov 02 20:47:21.930355 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 560/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:21 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:22.953770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:22.954467 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:22.960521 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:22.960994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:22.961423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:22.962115 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:22.962565 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:22.962983 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:23.171350 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:23.179154 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a08c1feb-cd6b-4a28-8c44-3997e6a96063 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.230290 Nov 02 20:47:23.179755 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 564/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:22 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:24.202511 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:24.203127 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:24.209475 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:24.209959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:24.210389 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:24.211075 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:24.211527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:24.211974 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:24.340371 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:24.348004 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-52f8fd29-e081-4c34-ae9f-e0f754d96965 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.149377 Nov 02 20:47:24.348575 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 561/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:24 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:25.371146 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:25.371783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:25.378136 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:25.378610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:25.379037 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:25.379750 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:25.380204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:25.380623 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:25.508365 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:25.516541 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8a763c4d-3da4-4932-a1d0-9a18db91e118 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.149495 Nov 02 20:47:25.517109 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 565/1126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:25 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:26.539576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:26.540212 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:26.546635 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:26.547113 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:26.547539 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:26.548249 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:26.548700 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:26.549120 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:26.681443 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:26.689232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-616f7581-635a-4ca1-a68b-a32144923fef tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.153528 Nov 02 20:47:26.689800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 562/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:26 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:27.712641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:27.713250 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:27.720058 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:27.720534 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:27.720964 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:27.721653 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:27.726296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:27.726296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:27.850147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:27.858402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-04784f00-e3fb-4062-98ea-97f3e805fed6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.149661 Nov 02 20:47:27.858971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 566/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:27 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:28.879661 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:28.880268 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:28.882593 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:28.889007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:28.889491 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:28.889922 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:28.890610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:28.891093 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:28.891515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:29.019322 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:29.026951 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f6914f26-e774-4755-a639-4249aaec6446 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.151132 Nov 02 20:47:29.028614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 563/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:28 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:30.050279 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:30.050916 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:30.052971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:30.053628 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:30.060153 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:30.060632 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:30.061069 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:30.061755 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:30.062213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:30.062634 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:30.198063 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:30.205823 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0bd681ee-f121-40e7-aff7-f7c54e864d4b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.159379 Nov 02 20:47:30.206391 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 567/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:30 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:31.228242 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:31.228853 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:31.235264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:31.235786 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:31.236219 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:31.236903 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:31.237358 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:31.237778 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:31.369946 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:31.378344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a3ae313a-8e6f-45c9-a582-05b274c86099 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.153890 Nov 02 20:47:31.378921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 564/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:31 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:32.402471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:32.403130 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:32.409633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:32.410114 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:32.410542 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:32.411231 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:32.411705 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:32.412128 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:32.539573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:32.547875 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-16c666fd-3500-4b93-a1c3-144ac7b2f55d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.149369 Nov 02 20:47:32.548441 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 568/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:32 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:33.022018 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-1609cecb-918a-4fdf-8a32-ad4564e1ba07 req-6162e0ae-5015-402a-ace4-0edc08a49994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76332b41-4b20-4056-a012-0ff87d99138c", "name": "network-vif-plugged", "status": "completed", "tag": "7ca48e17-28e4-419c-89e6-7f1b2d459420"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:33.032925 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-1609cecb-918a-4fdf-8a32-ad4564e1ba07 req-6162e0ae-5015-402a-ace4-0edc08a49994 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:33.033401 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-1609cecb-918a-4fdf-8a32-ad4564e1ba07 req-6162e0ae-5015-402a-ace4-0edc08a49994 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:33.033824 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-1609cecb-918a-4fdf-8a32-ad4564e1ba07 req-6162e0ae-5015-402a-ace4-0edc08a49994 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:33.045647 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-1609cecb-918a-4fdf-8a32-ad4564e1ba07 req-6162e0ae-5015-402a-ace4-0edc08a49994 service nova] Creating event network-vif-plugged:7ca48e17-28e4-419c-89e6-7f1b2d459420 for instance 76332b41-4b20-4056-a012-0ff87d99138c on hv-cinder-86236 Nov 02 20:47:33.050699 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-1609cecb-918a-4fdf-8a32-ad4564e1ba07 req-6162e0ae-5015-402a-ace4-0edc08a49994 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089460 Nov 02 20:47:33.051468 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 565/1133] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:47:33.571450 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:33.572286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:33.579383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:33.579879 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:33.580308 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:33.580989 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:33.581434 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:33.581851 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:33.713926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:33.722620 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-c4c76e9a-eb66-4b37-a76f-a9f98b468869 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.155053 Nov 02 20:47:33.723209 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 569/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:33 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:34.747262 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:34.748134 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:34.755246 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:34.755806 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:34.756186 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:34.756882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:34.757328 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:34.757742 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:34.838456 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1560690550", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1643622842", "security_groups": [{"name": "tempest-secgroup-smoke-957565563"}], "block_device_mapping_v2": [{"uuid": "8ef534db-aac0-4498-9512-8cc7b0272c75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7606db48-5c2f-421e-bbd0-08f46d425024"}]}} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:34.900005 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:34.908168 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2c0a09c0-0c73-467d-991e-9fb3cfb793e9 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1259 microversion: 2.1 time: 0.165771 Nov 02 20:47:34.908732 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 566/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:34 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:34.957727 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.network.neutron [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] validate_networks() for [('7606db48-5c2f-421e-bbd0-08f46d425024', None, None, None, None, None)] {{(pid=118986) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 20:47:35.413751 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Flavor limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 20:47:35.414175 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Image limits 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 20:47:35.414672 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Flavor pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 20:47:35.415166 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Image pref 0:0:0 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 20:47:35.415580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.virt.hardware [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 20:47:35.424787 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:35.425270 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:35.425704 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:35.426430 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:35.426886 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:35.427309 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:35.444696 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for project 02f491b87b30459495465d90dece762c. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 20:47:35.449492 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.quota [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Getting quotas for user d128e7c1d70c41c29e5ac77d59378fac and project 02f491b87b30459495465d90dece762c. Resources: {'instances', 'cores', 'ram'} {{(pid=118986) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 20:47:35.505831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Going to run 1 instances... {{(pid=118986) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 20:47:35.508073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ef534db-aac0-4498-9512-8cc7b0272c75',volume_size=None,volume_type=None)] {{(pid=118986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 20:47:35.637234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bb6c3622-7bfe-4d7d-b7aa-05997ff6b82a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.802035 Nov 02 20:47:35.637991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 570/1136] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 20:47:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 20:47:35.648937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4662d126-145e-4ebd-bd03-65da1a9fa4cc tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:35.649553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4662d126-145e-4ebd-bd03-65da1a9fa4cc tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:35.706080 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4662d126-145e-4ebd-bd03-65da1a9fa4cc tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:35.712968 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4662d126-145e-4ebd-bd03-65da1a9fa4cc tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1095 microversion: 2.1 time: 0.067889 Nov 02 20:47:35.713569 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 567/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:35 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:35.932101 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:35.932715 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:35.939296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:35.939863 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:35.940452 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:35.941157 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:35.941610 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:35.942037 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:36.079065 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:36.087626 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a3acd70d-db75-460b-8236-7cce33536cd1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1442 microversion: 2.1 time: 0.159880 Nov 02 20:47:36.094010 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 571/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:35 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:36.109789 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:36.110455 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:36.117639 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:36.118119 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:36.118548 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:36.119248 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:36.119725 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:36.120149 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:36.261023 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:36.269689 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e6c6b2e1-5e60-4728-828b-a1247de0959d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1442 microversion: 2.1 time: 0.163883 Nov 02 20:47:36.270267 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 568/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:36 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:36.736319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:36.737451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:36.743724 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:36.744580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:36.745182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:36.746881 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:36.747509 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:36.748195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:37.125383 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:37.132948 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b7fdbcd6-3c20-4af0-9ed0-8ce54ddfee6c tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1201 microversion: 2.1 time: 0.400532 Nov 02 20:47:37.133532 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 572/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:36 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1201 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:38.158275 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:38.158885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:38.166519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:38.167010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:38.167438 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:38.169349 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:38.169805 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:38.170230 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:38.307160 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:38.316954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ac446463-a85a-4e11-b390-eaba36b00367 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.161825 Nov 02 20:47:38.318301 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 569/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:38 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:39.232260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-cce692c6-6c03-4052-bf26-c760e53ef09c req-0361fec9-9e84-4e5a-993a-b80e57b01383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76332b41-4b20-4056-a012-0ff87d99138c", "tag": "7ca48e17-28e4-419c-89e6-7f1b2d459420"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:39.242343 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-cce692c6-6c03-4052-bf26-c760e53ef09c req-0361fec9-9e84-4e5a-993a-b80e57b01383 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:39.243808 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-cce692c6-6c03-4052-bf26-c760e53ef09c req-0361fec9-9e84-4e5a-993a-b80e57b01383 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:39.244356 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-cce692c6-6c03-4052-bf26-c760e53ef09c req-0361fec9-9e84-4e5a-993a-b80e57b01383 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:39.257887 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-cce692c6-6c03-4052-bf26-c760e53ef09c req-0361fec9-9e84-4e5a-993a-b80e57b01383 service nova] Creating event network-changed:7ca48e17-28e4-419c-89e6-7f1b2d459420 for instance 76332b41-4b20-4056-a012-0ff87d99138c on hv-cinder-86236 Nov 02 20:47:39.263137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-cce692c6-6c03-4052-bf26-c760e53ef09c req-0361fec9-9e84-4e5a-993a-b80e57b01383 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035884 Nov 02 20:47:39.263947 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 573/1142] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:47:39.343828 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:39.344446 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:39.351050 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:39.351774 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:39.352207 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:39.352897 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:39.353531 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:39.353959 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:39.496276 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:39.507169 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1d4610f6-a163-4664-b381-236fea24f56a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.167211 Nov 02 20:47:39.508009 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 570/1143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:39 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:40.531697 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:40.532398 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:40.538515 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:40.538992 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:40.539423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:40.540131 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:40.540584 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:40.541004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:40.675102 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:40.682753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-9155793f-9795-445c-8796-2b74ade6c3f9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.155867 Nov 02 20:47:40.684225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 574/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:40 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:41.287597 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-a5ba7dd4-86e1-478d-b1e8-3af2736b6cdf req-98b52ae3-f29c-4091-8d87-21ee90164496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff178e67-0b71-460a-8347-dc21f7f97496", "tag": "af0964b3-b046-48dd-bfcd-d8e351cc9b0c"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:41.298148 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a5ba7dd4-86e1-478d-b1e8-3af2736b6cdf req-98b52ae3-f29c-4091-8d87-21ee90164496 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:41.298618 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a5ba7dd4-86e1-478d-b1e8-3af2736b6cdf req-98b52ae3-f29c-4091-8d87-21ee90164496 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:41.299039 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a5ba7dd4-86e1-478d-b1e8-3af2736b6cdf req-98b52ae3-f29c-4091-8d87-21ee90164496 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:41.309822 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-a5ba7dd4-86e1-478d-b1e8-3af2736b6cdf req-98b52ae3-f29c-4091-8d87-21ee90164496 service nova] Creating event network-changed:af0964b3-b046-48dd-bfcd-d8e351cc9b0c for instance ff178e67-0b71-460a-8347-dc21f7f97496 on hv-cinder-86236 Nov 02 20:47:41.314800 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-a5ba7dd4-86e1-478d-b1e8-3af2736b6cdf req-98b52ae3-f29c-4091-8d87-21ee90164496 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030871 Nov 02 20:47:41.315368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 571/1145] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:47:41.706094 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:41.706651 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:41.712859 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:41.713340 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:41.713775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:41.715083 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:41.715546 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:41.715991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:41.926629 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:41.934413 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-0abb6968-08c0-48a2-8b64-a474580810a3 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.232365 Nov 02 20:47:41.934993 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 575/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:41 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:42.957085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:42.957804 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:42.965067 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:42.965586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:42.966011 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:42.966691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:42.967140 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:42.967555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:43.099189 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:43.106857 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-140e01e5-091f-45fd-b8f4-544e2aacc4e7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.153984 Nov 02 20:47:43.107427 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 572/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:42 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:44.130252 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:44.130864 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:44.138246 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:44.138730 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:44.139169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:44.139895 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:44.140358 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:44.140784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:44.272817 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:44.280586 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4ff85bd4-9a66-4984-b93f-ac6741ba71e1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.154250 Nov 02 20:47:44.281160 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 576/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:44 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:45.303311 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:45.303947 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:45.310403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:45.310881 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:45.311309 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:45.312023 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:45.312476 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:45.312898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:45.440089 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:45.448153 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-a25f83f7-8974-4fae-ae30-ca95eabd2463 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.148664 Nov 02 20:47:45.448724 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 573/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:45 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:46.471507 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:46.472156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:46.474093 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=2 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:46.474865 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell0:SELECT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:46.480438 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:46.480918 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:46.481351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:46.482040 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:46.482489 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:46.482908 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:46.611183 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:46.618806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-77621230-e6ba-46b3-8cb9-79721f3e4028 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.151306 Nov 02 20:47:46.619375 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 577/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:46 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:47.644313 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:47.644860 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:47.646767 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell0:SELECT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:47.652410 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:47.652882 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:47.653310 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:47.653987 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:47.654433 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:47.654846 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:47.788440 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:47.796758 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8d65676e-4e81-41f7-bbda-434720b8b67f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.155806 Nov 02 20:47:47.797325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 574/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:47 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:48.819362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:48.820000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:48.822536 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:48.828965 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:48.829449 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:48.829890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:48.830591 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:48.831044 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:48.831475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:48.834902 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=87 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:48.965671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:48.974121 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-83568b13-0d3c-4e8d-8589-14102f6ca273 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.158608 Nov 02 20:47:48.974680 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 578/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:48 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:49.996529 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:49.997134 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:49.999515 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=39 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:50.005060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:50.005530 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:50.005954 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:50.006631 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:50.007078 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:50.007488 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:50.010000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=83 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:47:50.136097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:50.143918 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9c62e33f-d012-4ff7-ad50-cb0e6762981d tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.151070 Nov 02 20:47:50.144390 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 575/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:49 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:51.166754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:51.167362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:51.173871 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:51.174344 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:51.174775 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:51.175454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:51.175957 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:51.176380 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:51.303743 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:51.311341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-cb64a794-cd1d-4315-b523-f49bcfd0e2b0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.148414 Nov 02 20:47:51.311987 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 579/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:51 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:52.334288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:52.334839 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:52.341188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:52.341665 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:52.342092 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:52.343388 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:52.343970 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:52.344403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:52.475115 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:52.482953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b99e2daf-d46d-4efb-b8e3-218cb1f830a7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.152600 Nov 02 20:47:52.484294 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 576/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:52 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:53.055565 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-bad8bbcf-8a7f-47ed-864b-85b7b1bfda59 req-1ed46ebc-2893-4d9d-8c36-16fc99fbd388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff178e67-0b71-460a-8347-dc21f7f97496", "name": "network-vif-plugged", "status": "completed", "tag": "af0964b3-b046-48dd-bfcd-d8e351cc9b0c"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:53.066071 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-bad8bbcf-8a7f-47ed-864b-85b7b1bfda59 req-1ed46ebc-2893-4d9d-8c36-16fc99fbd388 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:53.066556 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-bad8bbcf-8a7f-47ed-864b-85b7b1bfda59 req-1ed46ebc-2893-4d9d-8c36-16fc99fbd388 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:53.066991 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-bad8bbcf-8a7f-47ed-864b-85b7b1bfda59 req-1ed46ebc-2893-4d9d-8c36-16fc99fbd388 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:53.079137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-bad8bbcf-8a7f-47ed-864b-85b7b1bfda59 req-1ed46ebc-2893-4d9d-8c36-16fc99fbd388 service nova] Creating event network-vif-plugged:af0964b3-b046-48dd-bfcd-d8e351cc9b0c for instance ff178e67-0b71-460a-8347-dc21f7f97496 on hv-cinder-86236 Nov 02 20:47:53.084213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-bad8bbcf-8a7f-47ed-864b-85b7b1bfda59 req-1ed46ebc-2893-4d9d-8c36-16fc99fbd388 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Nov 02 20:47:53.084828 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 580/1156] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:47:53.509068 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:53.509616 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:53.515994 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:53.516470 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:53.516895 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:53.517577 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:53.518023 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:53.518438 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:53.648233 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:53.655898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-b31d31be-7cd4-4f75-b67d-96540ffca4b9 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.150756 Nov 02 20:47:53.656465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 577/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:53 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:54.679252 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:54.679976 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:54.686023 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:54.687059 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:54.687512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:54.688221 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:54.688671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:54.689092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:54.826641 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:54.834997 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-90d33749-dece-460c-ba05-a8d074d17e94 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1266 microversion: 2.1 time: 0.160411 Nov 02 20:47:54.835569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 581/1158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:54 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:55.856788 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:55.857395 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:55.864013 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:55.864489 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:55.864920 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:55.865599 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:55.866047 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:55.866461 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:55.993174 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:56.001289 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-4ac9daa8-f7a6-4485-b654-380a8f8ccb91 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1453 microversion: 2.1 time: 0.148306 Nov 02 20:47:56.001855 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 578/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:55 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:56.022863 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:47:56.023473 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:47:56.029757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:56.030722 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:56.031156 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:56.031885 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:56.032338 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:56.032762 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:56.162241 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:47:56.169911 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-89467a4e-7cba-4406-954a-fd0335f52e6f tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1453 microversion: 2.1 time: 0.150847 Nov 02 20:47:56.170475 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 582/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:47:56 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:47:57.809576 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-a6c12654-2155-41f4-9de5-6537c99edcaf req-67e39c91-fae8-4f99-939c-c6682a50bec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff178e67-0b71-460a-8347-dc21f7f97496", "tag": "af0964b3-b046-48dd-bfcd-d8e351cc9b0c"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:47:57.819538 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a6c12654-2155-41f4-9de5-6537c99edcaf req-67e39c91-fae8-4f99-939c-c6682a50bec2 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:47:57.820126 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a6c12654-2155-41f4-9de5-6537c99edcaf req-67e39c91-fae8-4f99-939c-c6682a50bec2 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:47:57.820640 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-a6c12654-2155-41f4-9de5-6537c99edcaf req-67e39c91-fae8-4f99-939c-c6682a50bec2 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:47:57.832391 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-a6c12654-2155-41f4-9de5-6537c99edcaf req-67e39c91-fae8-4f99-939c-c6682a50bec2 service nova] Creating event network-changed:af0964b3-b046-48dd-bfcd-d8e351cc9b0c for instance ff178e67-0b71-460a-8347-dc21f7f97496 on hv-cinder-86236 Nov 02 20:47:57.837553 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-a6c12654-2155-41f4-9de5-6537c99edcaf req-67e39c91-fae8-4f99-939c-c6682a50bec2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031648 Nov 02 20:47:57.838220 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 579/1161] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:50:00.442246 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR oslo.messaging._drivers.impl_rabbit [-] [68ae627a-0d4d-470f-99b6-231dac387d4c] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 20:50:00.442759 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=9 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:00.443402 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=25 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:00.444198 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 20:50:00.444451 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Wed Nov 2 20:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 (ip 10.222.0.26) !!! Nov 02 20:50:00.447245 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6cdd8ff-fd59-4a46-9d72-91932b6c2724] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 20:50:00.447245 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=9 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:00.447774 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=25 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:00.448777 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 20:50:00.448997 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Wed Nov 2 20:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Nov 02 20:50:00.449421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:00.449673 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:00.450426 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 20:50:00.450583 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Wed Nov 2 20:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Nov 02 20:50:00.459156 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-07b0837d-a5fc-4ef7-8237-43e3b9741927 req-f5497025-4d2e-41c2-a96f-367844787c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff178e67-0b71-460a-8347-dc21f7f97496", "tag": "af0964b3-b046-48dd-bfcd-d8e351cc9b0c"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:00.467942 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:00.469204 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:00.469362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:00.469947 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-07b0837d-a5fc-4ef7-8237-43e3b9741927 req-f5497025-4d2e-41c2-a96f-367844787c01 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:00.470091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:00.470422 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-07b0837d-a5fc-4ef7-8237-43e3b9741927 req-f5497025-4d2e-41c2-a96f-367844787c01 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:00.470548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:00.470841 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-07b0837d-a5fc-4ef7-8237-43e3b9741927 req-f5497025-4d2e-41c2-a96f-367844787c01 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:00.470967 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:00.483168 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-07b0837d-a5fc-4ef7-8237-43e3b9741927 req-f5497025-4d2e-41c2-a96f-367844787c01 service nova] Creating event network-changed:af0964b3-b046-48dd-bfcd-d8e351cc9b0c for instance ff178e67-0b71-460a-8347-dc21f7f97496 on hv-cinder-86236 Nov 02 20:50:00.491425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-07b0837d-a5fc-4ef7-8237-43e3b9741927 req-f5497025-4d2e-41c2-a96f-367844787c01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047879 Nov 02 20:50:00.492403 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 580/1162] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:50:00.503370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:50:00.597681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-a2f804b6-dec4-409b-807c-cdc5e69f1900 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 204 len: 0 microversion: 2.1 time: 0.157277 Nov 02 20:50:00.599104 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 583/1163] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:50:00 2022] DELETE /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:50:00.611199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:00.612133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:00.620249 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:00.621244 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:00.621682 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:00.622561 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:00.623191 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:00.623636 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:00.760189 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:00.768586 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ee8af7dd-e87d-4289-8741-9c5ddcc476c7 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1578 microversion: 2.1 time: 0.164395 Nov 02 20:50:00.769188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 581/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:00 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:50:01.792120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:01.792824 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:01.801087 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:01.801569 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:01.802000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:01.802693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:01.803141 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:01.803565 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:01.820278 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO oslo.messaging._drivers.impl_rabbit [-] [68ae627a-0d4d-470f-99b6-231dac387d4c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 59292. Nov 02 20:50:01.966604 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:01.974882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5999ab52-d798-4eb1-a70d-5f8d1f1f93a0 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1578 microversion: 2.1 time: 0.187083 Nov 02 20:50:01.975448 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 584/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:01 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:02.975241 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-7e2f8f0d-7210-4983-a81f-0faa25bdaeed req-34566cc9-7c41-4b15-9a3a-d5ec16752227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff178e67-0b71-460a-8347-dc21f7f97496", "name": "network-vif-deleted", "tag": "af0964b3-b046-48dd-bfcd-d8e351cc9b0c"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:02.985993 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7e2f8f0d-7210-4983-a81f-0faa25bdaeed req-34566cc9-7c41-4b15-9a3a-d5ec16752227 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:02.986394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7e2f8f0d-7210-4983-a81f-0faa25bdaeed req-34566cc9-7c41-4b15-9a3a-d5ec16752227 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:02.986818 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-7e2f8f0d-7210-4983-a81f-0faa25bdaeed req-34566cc9-7c41-4b15-9a3a-d5ec16752227 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:02.990316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6cdd8ff-fd59-4a46-9d72-91932b6c2724] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 59298. Nov 02 20:50:03.000334 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:03.001015 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:03.004535 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-7e2f8f0d-7210-4983-a81f-0faa25bdaeed req-34566cc9-7c41-4b15-9a3a-d5ec16752227 service nova] Creating event network-vif-deleted:af0964b3-b046-48dd-bfcd-d8e351cc9b0c for instance ff178e67-0b71-460a-8347-dc21f7f97496 on hv-cinder-86236 Nov 02 20:50:03.007169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:03.007693 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:03.008135 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:03.008882 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:03.009339 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:03.009671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-7e2f8f0d-7210-4983-a81f-0faa25bdaeed req-34566cc9-7c41-4b15-9a3a-d5ec16752227 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042330 Nov 02 20:50:03.009814 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:03.010280 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 582/1166] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:50:03.075714 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:03.084223 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4a59fe1f-596d-4493-a3af-01de15a1a105 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 200 len: 1226 microversion: 2.1 time: 0.089520 Nov 02 20:50:03.085041 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 585/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:02 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:50:04.073685 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:04.074288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:04.081330 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:04.081740 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:04.082167 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:04.082843 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:04.083288 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:04.083731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:04.107527 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.objects.instance [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lazy-loading 'flavor' on Instance uuid 76332b41-4b20-4056-a012-0ff87d99138c {{(pid=118985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 20:50:04.108900 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:04.109671 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: ff178e67-0b71-460a-8347-dc21f7f97496] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:04.117935 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:04.118514 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:04.118963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:04.119802 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:04.120260 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:04.120690 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:04.136032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] HTTP exception thrown: Instance ff178e67-0b71-460a-8347-dc21f7f97496 could not be found. Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Request method failure captured: Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 HTTP/1.1 Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtYOdPsra39htrmk_FHmEmjN98hd71w_tV_RxcMVko9hz4jDeSsrZOBSl0vZJ0xj8NUBD_FOMeIwgrvfb4G01HtPLFsmGqLSBWTfoPs4tIieiYKmmvyVhDlXpGt56WKeZPH-QOT3tWo75MC7ryRmYfcYNGAWxLvQx1z5mlnixlJKGdU Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:50:04.137684 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02f491b87b30459495465d90dece762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02f491b87b30459495465d90dece762c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}] Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: d128e7c1d70c41c29e5ac77d59378fac Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance ff178e67-0b71-460a-8347-dc21f7f97496 could not be found. Nov 02 20:50:04.139286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'ff178e67-0b71-460a-8347-dc21f7f97496'} Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff178e67-0b71-460a-8347-dc21f7f97496 could not be found. Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:50:04.140757 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff178e67-0b71-460a-8347-dc21f7f97496 could not be found. Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff178e67-0b71-460a-8347-dc21f7f97496 could not be found. Nov 02 20:50:04.142795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:04.144986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Returning 404 to user: Instance ff178e67-0b71-460a-8347-dc21f7f97496 could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:50:04.144986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-7d5a5803-d0d3-4e32-8c75-f3f1fbee2aa5 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496" status: 404 len: 111 microversion: 2.1 time: 0.034348 Nov 02 20:50:04.144986 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 586/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:04 2022] GET /compute/v2.1/servers/ff178e67-0b71-460a-8347-dc21f7f97496 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 20:50:04.182537 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8152dcae-83c5-4eac-a068-573e36619d89 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "POST /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c/action" status: 202 len: 0 microversion: 2.1 time: 0.113605 Nov 02 20:50:04.183127 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 583/1169] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:50:04 2022] POST /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:50:04.192718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:04.193520 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:04.200783 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:04.201144 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:04.201602 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:04.202543 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:04.203014 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:04.203462 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:04.354549 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:04.362346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-37e73a55-d408-43ff-b351-358034a2c34c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.174846 Nov 02 20:50:04.362906 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 587/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:04 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:05.386921 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:05.387644 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:05.394541 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:05.395017 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:05.395448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:05.396164 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:05.396614 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:05.397032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:05.525756 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:05.534085 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-613b604f-98d3-474a-a779-1a94640a807e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.151901 Nov 02 20:50:05.534649 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 584/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:05 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:06.557362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:06.558178 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:06.564635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:06.565184 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:06.565616 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:06.566310 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:06.566754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:06.567169 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:06.765702 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:06.773956 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-bbdf4456-726b-4d7c-a462-026eae357e8d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.220504 Nov 02 20:50:06.774534 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 588/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:06 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:07.546010 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:07.546522 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:07.553792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-e3b763d9-cf9a-4e58-9b98-346692bc6acc req-36809084-8828-4a4b-9469-56359dfdd3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c4e1a0-2cf5-4a94-a7b9-872748160fe4", "tag": "5761d096-ea48-406b-aa4a-e24ad6d9213c"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:07.566529 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-e3b763d9-cf9a-4e58-9b98-346692bc6acc req-36809084-8828-4a4b-9469-56359dfdd3ea service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:07.567137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-e3b763d9-cf9a-4e58-9b98-346692bc6acc req-36809084-8828-4a4b-9469-56359dfdd3ea service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:07.567427 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-e3b763d9-cf9a-4e58-9b98-346692bc6acc req-36809084-8828-4a4b-9469-56359dfdd3ea service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:07.574030 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:07.574519 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:07.574953 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:07.575675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:07.576133 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:07.576555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:07.582220 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-e3b763d9-cf9a-4e58-9b98-346692bc6acc req-36809084-8828-4a4b-9469-56359dfdd3ea service nova] Creating event network-changed:5761d096-ea48-406b-aa4a-e24ad6d9213c for instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 on hv-cinder-86236 Nov 02 20:50:07.587740 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-e3b763d9-cf9a-4e58-9b98-346692bc6acc req-36809084-8828-4a4b-9469-56359dfdd3ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037111 Nov 02 20:50:07.588547 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 589/1173] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:50:07.604459 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Going to try to terminate instance {{(pid=118985) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:50:07.702849 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ea786e88-9541-41b5-819a-355d3d642081 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 204 len: 0 microversion: 2.1 time: 0.160438 Nov 02 20:50:07.707167 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 585/1174] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:50:07 2022] DELETE /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:50:07.712200 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:07.712905 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:07.719109 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:07.719594 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:07.720117 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:07.720816 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:07.721271 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:07.721764 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:07.798712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:07.800031 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:07.806316 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:07.806916 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:07.807413 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:07.808198 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:07.808712 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:07.809222 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:07.889004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:07.900263 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-904ac856-1454-4815-a038-0822b3b11607 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1578 microversion: 2.1 time: 0.192161 Nov 02 20:50:07.900844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 590/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:07 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:50:07.949940 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:07.958713 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d4c6072a-71e4-4d05-b8ad-18de590e8f5b tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.164857 Nov 02 20:50:07.959336 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 586/1176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:07 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:50:08.924917 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:08.925504 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:08.931769 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:08.932255 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:08.932689 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:08.933388 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:08.933958 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:08.934256 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:08.981950 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:08.982574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:08.989748 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:08.990232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:08.990663 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:08.991360 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:08.991840 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:08.992264 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:09.116214 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:09.124524 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-ee6741a9-8217-452d-835f-7c02dbad1997 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1578 microversion: 2.1 time: 0.204210 Nov 02 20:50:09.125109 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 591/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:08 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:09.131743 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:09.139479 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f68f47f6-e172-4832-b64b-4fed61dc17b3 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.161679 Nov 02 20:50:09.140086 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 587/1178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:08 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:50:10.143207 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-475277ff-9ba1-484a-83ff-1af3c090e317 req-c6cc2ebb-2e91-414d-ad5a-bc8785d1269e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c4e1a0-2cf5-4a94-a7b9-872748160fe4", "name": "network-vif-deleted", "tag": "5761d096-ea48-406b-aa4a-e24ad6d9213c"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:10.147587 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:10.148671 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:10.153201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-475277ff-9ba1-484a-83ff-1af3c090e317 req-c6cc2ebb-2e91-414d-ad5a-bc8785d1269e service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:10.153691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-475277ff-9ba1-484a-83ff-1af3c090e317 req-c6cc2ebb-2e91-414d-ad5a-bc8785d1269e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:10.154116 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-475277ff-9ba1-484a-83ff-1af3c090e317 req-c6cc2ebb-2e91-414d-ad5a-bc8785d1269e service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:10.155161 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:10.155730 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:10.156260 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:10.157184 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:10.157880 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:10.158521 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:10.167195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-475277ff-9ba1-484a-83ff-1af3c090e317 req-c6cc2ebb-2e91-414d-ad5a-bc8785d1269e service nova] Creating event network-vif-deleted:5761d096-ea48-406b-aa4a-e24ad6d9213c for instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 on hv-cinder-86236 Nov 02 20:50:10.172557 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-475277ff-9ba1-484a-83ff-1af3c090e317 req-c6cc2ebb-2e91-414d-ad5a-bc8785d1269e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033572 Nov 02 20:50:10.176418 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 592/1179] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:50:10.182421 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:10.183898 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:10.190939 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:10.191423 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:10.191891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:10.192681 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:10.193134 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:10.193557 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:10.232333 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128e7c1d70c41c29e5ac77d59378fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f491b87b30459495465d90dece762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:10.243448 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-121183e9-b767-471f-af6c-ac9ae6dd9052 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 200 len: 1392 microversion: 2.1 time: 0.099766 Nov 02 20:50:10.244061 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 588/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:10 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 1392 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:50:10.330180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:10.337789 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-182c8c01-9801-41c5-8804-0352c9ea0c1d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.160368 Nov 02 20:50:10.338384 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 593/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:10 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:11.267342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:11.267964 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: 81c4e1a0-2cf5-4a94-a7b9-872748160fe4] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:11.277457 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.277944 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.278379 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.279066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.279514 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.279957 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.294771 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] HTTP exception thrown: Instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 could not be found. Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Request method failure captured: Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 HTTP/1.1 Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtYOdPsra39htrmk_FHmEmjN98hd71w_tV_RxcMVko9hz4jDeSsrZOBSl0vZJ0xj8NUBD_FOMeIwgrvfb4G01HtPLFsmGqLSBWTfoPs4tIieiYKmmvyVhDlXpGt56WKeZPH-QOT3tWo75MC7ryRmYfcYNGAWxLvQx1z5mlnixlJKGdU Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:50:11.296449 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02f491b87b30459495465d90dece762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02f491b87b30459495465d90dece762c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}] Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: d128e7c1d70c41c29e5ac77d59378fac Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 could not be found. Nov 02 20:50:11.299235 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': '81c4e1a0-2cf5-4a94-a7b9-872748160fe4'} Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 could not be found. Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:50:11.300182 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 could not be found. Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 could not be found. Nov 02 20:50:11.301877 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.303385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Returning 404 to user: Instance 81c4e1a0-2cf5-4a94-a7b9-872748160fe4 could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:50:11.303385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-172b6ae1-abbb-476a-98a4-d6b7ce3bd1c2 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4" status: 404 len: 111 microversion: 2.1 time: 0.035409 Nov 02 20:50:11.303385 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 589/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:11 2022] GET /compute/v2.1/servers/81c4e1a0-2cf5-4a94-a7b9-872748160fe4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:50:11.362141 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:11.363060 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:11.370290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.370903 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.371459 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.372317 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.372872 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.373394 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.535792 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:11.544065 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-84fcf3a6-8900-4c19-a985-2a2a5511029a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.186414 Nov 02 20:50:11.544754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 594/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:11 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:11.826232 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:11.826727 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:11.833060 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.833537 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.833961 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.834695 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.835144 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.835564 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.849465 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.wsgi [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] HTTP exception thrown: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Request method failure captured: Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: request: DELETE /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad HTTP/1.1 Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept: application/json Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Accept-Encoding: identity Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Connection: close Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Length: 0 Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Content-Type: application/json Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Host: 10.222.0.26 Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: Openstack-System-Scope: None Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: User-Agent: python-urllib3/1.26.12 Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Auth-Token: gAAAAABjYtYOdPsra39htrmk_FHmEmjN98hd71w_tV_RxcMVko9hz4jDeSsrZOBSl0vZJ0xj8NUBD_FOMeIwgrvfb4G01HtPLFsmGqLSBWTfoPs4tIieiYKmmvyVhDlXpGt56WKeZPH-QOT3tWo75MC7ryRmYfcYNGAWxLvQx1z5mlnixlJKGdU Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Id: None Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Domain-Name: None Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Identity-Status: Confirmed Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Is-Admin-Project: True Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Id: default Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Domain-Name: Default Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Project-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Role: reader,member Nov 02 20:50:11.851000 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Roles: reader,member Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02f491b87b30459495465d90dece762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02f491b87b30459495465d90dece762c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}] Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-Tenant-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Id: default Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Domain-Name: Default Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Id: d128e7c1d70c41c29e5ac77d59378fac Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: X-User-Name: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: method: > Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: exception: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.852798 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: action_args: {'id': 'e88fb0dd-4264-4940-a1d4-7a56d751faad'} Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:50:11.853811 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.855407 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.857368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Returning 404 to user: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. {{(pid=118985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:50:11.857368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e331cc85-f5a3-400b-8b7a-1f4f78df36b1 tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 404 len: 111 microversion: 2.1 time: 0.030396 Nov 02 20:50:11.857368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 590/1184] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:50:11 2022] DELETE /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:50:11.862580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:11.863194 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] [instance: e88fb0dd-4264-4940-a1d4-7a56d751faad] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:11.869335 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.869857 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.870290 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.870978 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:11.871429 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:11.871877 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:11.885795 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] HTTP exception thrown: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Request method failure captured: Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad HTTP/1.1 Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtYOdPsra39htrmk_FHmEmjN98hd71w_tV_RxcMVko9hz4jDeSsrZOBSl0vZJ0xj8NUBD_FOMeIwgrvfb4G01HtPLFsmGqLSBWTfoPs4tIieiYKmmvyVhDlXpGt56WKeZPH-QOT3tWo75MC7ryRmYfcYNGAWxLvQx1z5mlnixlJKGdU Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:50:11.887512 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02f491b87b30459495465d90dece762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02f491b87b30459495465d90dece762c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02f491b87b30459495465d90dece762c"}]}] Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 02f491b87b30459495465d90dece762c Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-TestVolumeBootPattern-102500767 Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: d128e7c1d70c41c29e5ac77d59378fac Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-TestVolumeBootPattern-102500767-project Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.889286 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': 'e88fb0dd-4264-4940-a1d4-7a56d751faad'} Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:50:11.890409 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. Nov 02 20:50:11.892080 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:50:11.893767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Returning 404 to user: Instance e88fb0dd-4264-4940-a1d4-7a56d751faad could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:50:11.893767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-81ecdaf2-e214-4859-8de9-6b1b340e3ebe tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad" status: 404 len: 111 microversion: 2.1 time: 0.030822 Nov 02 20:50:11.893767 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 595/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:11 2022] GET /compute/v2.1/servers/e88fb0dd-4264-4940-a1d4-7a56d751faad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:50:12.573347 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:12.573867 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:12.581032 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:12.581505 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:12.581931 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:12.582611 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:12.583055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:12.583467 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:12.716138 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:12.724322 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-1854b9bd-c9ab-4024-910c-f3a339226276 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.155056 Nov 02 20:50:12.725101 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 591/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:12 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:13.181952 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-4a0cadae-76aa-42be-a017-130eb29ec74a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] Calling method '.version_select at 0x7f2e2201aa60>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:13.209619 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-4a0cadae-76aa-42be-a017-130eb29ec74a tempest-TestVolumeBootPattern-102500767 tempest-TestVolumeBootPattern-102500767-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1643622842" status: 202 len: 0 microversion: 2.1 time: 0.031523 Nov 02 20:50:13.210195 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 596/1187] 10.222.0.26 () {58 vars in 1263 bytes} [Wed Nov 2 20:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1643622842 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:50:13.747731 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:13.748442 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:13.755545 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:13.756326 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:13.756462 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:13.757144 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:13.757592 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:13.758008 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:13.949474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:13.957256 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e124212f-28a4-42fe-a990-e49dd42dc1cd tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.213408 Nov 02 20:50:13.957825 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 592/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:13 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:14.981890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:14.983568 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:14.991471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:14.992122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:14.992741 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:14.993806 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:14.994514 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:14.995191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:15.327091 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:15.336890 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d5051e3d-3b60-406c-b391-a97694bbbd56 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.359020 Nov 02 20:50:15.338364 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 597/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:14 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:16.361473 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:16.362001 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:16.368431 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:16.368914 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:16.369342 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:16.370044 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:16.370493 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:16.370911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:16.609966 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:16.620493 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ff3b9056-238f-4b8e-ad78-0e6d72b74054 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.263169 Nov 02 20:50:16.632112 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 593/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:16 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:17.645844 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:17.646454 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:17.653070 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:17.656505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:17.656505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:17.656505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:17.656505 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:17.657006 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:17.818784 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:17.832063 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-64f22929-1f4e-4ad8-bdea-be65d8243ba1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1508 microversion: 2.1 time: 0.190837 Nov 02 20:50:17.838915 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 598/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:17 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:17.860304 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:17.861404 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:17.868374 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:17.868872 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:17.869309 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:17.870018 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:17.870474 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:17.871373 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:18.018937 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118985) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 20:50:18.070007 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:18.102610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-8e93a667-10cc-4c5c-9e6e-c9508b9b6c1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "POST /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c/action" status: 202 len: 0 microversion: 2.1 time: 0.250029 Nov 02 20:50:18.103966 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 594/1192] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 20:50:17 2022] POST /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 20:50:18.112665 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:18.113647 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:18.124271 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:18.124891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:18.125893 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:18.127362 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:18.128181 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:18.128726 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:18.401811 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:18.411302 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-b5a925b3-757b-4aef-a94a-9b0cd6fee464 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1516 microversion: 2.1 time: 0.303261 Nov 02 20:50:18.419092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 599/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:18 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:50:19.436070 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:19.436776 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:19.444382 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:19.444977 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:19.445607 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:19.446302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:19.446753 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:19.447302 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:19.580052 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:19.587880 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f9900f98-a85f-4b59-a056-0d892d5b0a1e tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1516 microversion: 2.1 time: 0.156794 Nov 02 20:50:19.588542 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 595/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:19 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:19.872988 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-0c952a78-8363-44a6-9d3d-a04a88055177 req-ae576eae-53a2-4d58-974f-b764fdc815ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76332b41-4b20-4056-a012-0ff87d99138c", "name": "network-vif-unplugged", "status": "completed", "tag": "7ca48e17-28e4-419c-89e6-7f1b2d459420"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:19.886548 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-0c952a78-8363-44a6-9d3d-a04a88055177 req-ae576eae-53a2-4d58-974f-b764fdc815ea service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:19.887240 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-0c952a78-8363-44a6-9d3d-a04a88055177 req-ae576eae-53a2-4d58-974f-b764fdc815ea service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:19.888118 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-0c952a78-8363-44a6-9d3d-a04a88055177 req-ae576eae-53a2-4d58-974f-b764fdc815ea service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:19.920228 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.compute.server_external_events [req-0c952a78-8363-44a6-9d3d-a04a88055177 req-ae576eae-53a2-4d58-974f-b764fdc815ea service nova] Unable to find a host for instance 76332b41-4b20-4056-a012-0ff87d99138c. Dropping event network-vif-unplugged {{(pid=118986) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 20:50:19.922361 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-0c952a78-8363-44a6-9d3d-a04a88055177 req-ae576eae-53a2-4d58-974f-b764fdc815ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053252 Nov 02 20:50:19.923234 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 600/1195] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 20:50:20.613105 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:20.614292 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:20.621066 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:20.621556 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:20.621988 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:20.622879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:20.623722 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:20.624190 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:20.765490 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:20.773319 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-bf1a8171-a61f-4146-a1fe-f0d390b9b23c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1516 microversion: 2.1 time: 0.164718 Nov 02 20:50:20.773898 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 596/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:20 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:21.797032 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:21.798132 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:21.804583 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:21.805057 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:21.805483 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:21.806162 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:21.806608 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:21.807022 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:21.933457 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:21.941654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-5121c0d6-999b-472f-985e-3672bc46dac6 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1516 microversion: 2.1 time: 0.148501 Nov 02 20:50:21.942225 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 601/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:21 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:22.964781 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:22.965394 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:22.972819 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:22.973299 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:22.973750 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:22.974425 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:22.974906 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:22.975368 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:23.101827 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:23.109571 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-ce819389-7948-4f3a-aad9-39bd89cf961c tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1518 microversion: 2.1 time: 0.148723 Nov 02 20:50:23.110717 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 597/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:22 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:24.134588 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:24.135191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:24.142191 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:24.143537 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:24.144004 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:24.144691 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:24.145137 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:24.145553 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:24.149644 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:24.378517 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:24.386147 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-521bbfcb-3bf2-4aaf-baad-f98f5061f9bc tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.255548 Nov 02 20:50:24.386711 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 602/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:24 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:25.409771 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:25.410378 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:25.416890 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:25.417363 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:25.417791 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:25.418468 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:25.418913 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:25.419325 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:25.551188 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:25.558915 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-0cb2ad4f-7c63-4aa0-a6ab-9289f5a764ac tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.153709 Nov 02 20:50:25.559478 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 598/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:25 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:26.582996 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:26.583731 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:26.590002 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:26.590471 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:26.590894 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:26.591571 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:26.592045 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:26.592459 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:26.720766 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:26.728544 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-d125da75-dd95-4e0b-b2f4-904852eb3990 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.150046 Nov 02 20:50:26.729113 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 603/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:26 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:27.754162 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:27.754785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:27.761278 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:27.761754 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:27.762185 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:27.762879 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:27.763335 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:27.763794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:27.892727 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:27.900344 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-63a6b44f-0d64-4373-a173-fe8e9c72ec94 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.150354 Nov 02 20:50:27.900911 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 599/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:27 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:28.922977 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:28.923580 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:28.930420 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:28.930889 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:28.931316 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:28.932024 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:28.932469 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:28.932884 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:29.063404 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:29.071730 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-98d4f92e-93b4-4c82-939b-4f21b8789aec tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.152612 Nov 02 20:50:29.072296 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 604/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:28 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:30.095038 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:30.095555 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:30.102271 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:30.102745 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:30.103171 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:30.103887 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:30.104340 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:30.104758 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:30.234097 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:30.241866 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-c8984af7-7767-4067-a167-4f67ef466045 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.150850 Nov 02 20:50:30.242435 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 600/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:30 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:31.265310 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:31.265913 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:31.268567 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:31.273635 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:31.274107 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:31.274533 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:31.275216 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:31.275683 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:31.276122 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:31.404825 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:31.413120 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8abee9c9-6862-4a6e-9cf1-2d86f6dca4aa tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.151670 Nov 02 20:50:31.413695 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 605/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:31 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:32.436518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:32.437128 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:32.439475 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:50:32.445300 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:32.445777 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:32.446205 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:32.446889 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:32.447343 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:32.447794 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:32.582691 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:32.590364 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-63970fe7-61c7-4b81-9b9c-b9ff70f98d10 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.157743 Nov 02 20:50:32.590933 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 601/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:32 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:33.614051 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:33.614625 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:33.620725 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:33.621201 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:33.621633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:33.622319 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:33.622770 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:33.623192 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:33.761341 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:33.769210 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e07b8a08-0cc0-4ff3-9d14-a109e0819666 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.159602 Nov 02 20:50:33.769994 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 606/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:33 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:34.793123 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:34.793757 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:34.799985 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:34.800397 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:34.800820 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:34.802157 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:34.802604 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:34.803019 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:34.931346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:34.938929 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-9cbd57b1-ea1a-422c-af81-4bf12cc2e039 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.149682 Nov 02 20:50:34.939494 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 602/1208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:34 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:35.891525 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [req-237e0298-27da-4bc1-b5ed-dee940e2734c req-81733910-369f-4030-84a8-0edd95178cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76332b41-4b20-4056-a012-0ff87d99138c", "name": "network-vif-plugged", "status": "completed", "tag": "7ca48e17-28e4-419c-89e6-7f1b2d459420"}]} {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:50:35.902439 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-237e0298-27da-4bc1-b5ed-dee940e2734c req-81733910-369f-4030-84a8-0edd95178cc0 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:35.902918 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-237e0298-27da-4bc1-b5ed-dee940e2734c req-81733910-369f-4030-84a8-0edd95178cc0 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:35.903342 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [req-237e0298-27da-4bc1-b5ed-dee940e2734c req-81733910-369f-4030-84a8-0edd95178cc0 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:35.915197 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.compute.server_external_events [req-237e0298-27da-4bc1-b5ed-dee940e2734c req-81733910-369f-4030-84a8-0edd95178cc0 service nova] Creating event network-vif-plugged:7ca48e17-28e4-419c-89e6-7f1b2d459420 for instance 76332b41-4b20-4056-a012-0ff87d99138c on hv-cinder-86236 Nov 02 20:50:35.920287 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [req-237e0298-27da-4bc1-b5ed-dee940e2734c req-81733910-369f-4030-84a8-0edd95178cc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032441 Nov 02 20:50:35.920946 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 607/1209] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:50:35.963939 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:35.964559 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:35.971374 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:35.971881 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:35.972307 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:35.974406 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:35.974883 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:35.975321 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:36.346055 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:36.354610 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-f37dbd87-48d7-4143-84ba-70acc26a247d tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.395319 Nov 02 20:50:36.355199 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 603/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:35 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:37.379039 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:37.379765 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:37.385847 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:37.386322 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:37.386753 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:37.387444 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:37.387926 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:37.388351 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:37.516465 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:37.524773 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-e704e9a5-420a-4e38-83df-08b39942dfa1 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1574 microversion: 2.1 time: 0.150511 Nov 02 20:50:37.525346 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 608/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:37 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:50:38.548286 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:50:38.548846 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:50:38.555885 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:38.556371 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:38.556801 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:38.557487 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:50:38.557935 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:50:38.558357 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:50:38.694588 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:50:38.702574 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-e05fad0f-2610-4d10-b62a-2c6e1d014229 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1561 microversion: 2.1 time: 0.158237 Nov 02 20:50:38.703145 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 604/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:50:38 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:52:06.553573 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:52:06.554133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:52:06.556310 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_api:SELECT=7 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:52:06.557111 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG dbcounter [-] [118986] Writing DB stats nova_cell1:SELECT=36 {{(pid=118986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:52:06.557831 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 20:52:06.557971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Wed Nov 2 20:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c (ip 10.222.0.26) !!! Nov 02 20:52:06.564702 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_api:SELECT=7 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:52:06.565732 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG dbcounter [-] [118985] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=118985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:52:06.576431 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:06.577133 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:06.577754 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:06.578633 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:06.579088 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:06.579713 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:06.608818 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Going to try to terminate instance {{(pid=118986) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 20:52:06.699180 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-fae88367-a814-42b1-b735-289f600d812a tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "DELETE /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 204 len: 0 microversion: 2.1 time: 0.149741 Nov 02 20:52:06.704033 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 609/1213] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 20:52:06 2022] DELETE /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 20:52:06.710654 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:52:06.711891 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:52:06.719213 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:06.720073 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:06.720854 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:06.721772 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:06.722491 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:06.723295 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:06.728135 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-5a605dda-0855-479d-bc64-499449d97fda req-8d60a314-b6f6-4364-a24a-c7540ff469ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76332b41-4b20-4056-a012-0ff87d99138c", "tag": "7ca48e17-28e4-419c-89e6-7f1b2d459420"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:52:06.742228 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-5a605dda-0855-479d-bc64-499449d97fda req-8d60a314-b6f6-4364-a24a-c7540ff469ed service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:06.743272 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-5a605dda-0855-479d-bc64-499449d97fda req-8d60a314-b6f6-4364-a24a-c7540ff469ed service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:06.743733 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-5a605dda-0855-479d-bc64-499449d97fda req-8d60a314-b6f6-4364-a24a-c7540ff469ed service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:06.754197 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-5a605dda-0855-479d-bc64-499449d97fda req-8d60a314-b6f6-4364-a24a-c7540ff469ed service nova] Creating event network-changed:7ca48e17-28e4-419c-89e6-7f1b2d459420 for instance 76332b41-4b20-4056-a012-0ff87d99138c on hv-cinder-86236 Nov 02 20:52:06.759687 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-5a605dda-0855-479d-bc64-499449d97fda req-8d60a314-b6f6-4364-a24a-c7540ff469ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200310 Nov 02 20:52:06.760440 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 605/1214] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 20:52:06.862502 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:52:06.870963 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-8797363b-65dd-4b33-bf7b-b1e0bddf27da tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.165522 Nov 02 20:52:06.871539 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 610/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:52:06 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:52:07.895346 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:52:07.896100 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.compute.api [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118985) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:52:07.902613 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:07.903090 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:07.903518 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:07.904227 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:07.904675 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:07.905088 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:08.045888 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.policy [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118985) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:52:08.053680 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-2933e9be-d0fc-465d-a080-842293742945 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1567 microversion: 2.1 time: 0.163154 Nov 02 20:52:08.054249 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 606/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:52:07 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 20:52:09.077677 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:52:09.078370 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:52:09.085585 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:09.086233 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:09.086760 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:09.087556 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:09.088093 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:09.088578 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:09.167718 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.policy [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4955b7580d544cfb91c44b8d4c6758dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05738aea94f0499a99582c6458880dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118986) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 20:52:09.182546 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [req-c667b3a6-3127-46e8-ba1a-f0b7fffbc46c req-ae6ecdc0-e7e4-4868-b3ee-b7fc80778699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76332b41-4b20-4056-a012-0ff87d99138c", "name": "network-vif-deleted", "tag": "7ca48e17-28e4-419c-89e6-7f1b2d459420"}]} {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 20:52:09.188839 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-120a77af-6636-4fa3-955c-fac262f80f11 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 200 len: 1381 microversion: 2.1 time: 0.115159 Nov 02 20:52:09.189442 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 611/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:52:09 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 1381 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 20:52:09.192114 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c667b3a6-3127-46e8-ba1a-f0b7fffbc46c req-ae6ecdc0-e7e4-4868-b3ee-b7fc80778699 service nova] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:09.192579 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c667b3a6-3127-46e8-ba1a-f0b7fffbc46c req-ae6ecdc0-e7e4-4868-b3ee-b7fc80778699 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:09.192999 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG oslo_concurrency.lockutils [req-c667b3a6-3127-46e8-ba1a-f0b7fffbc46c req-ae6ecdc0-e7e4-4868-b3ee-b7fc80778699 service nova] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:09.204893 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.compute.server_external_events [req-c667b3a6-3127-46e8-ba1a-f0b7fffbc46c req-ae6ecdc0-e7e4-4868-b3ee-b7fc80778699 service nova] Creating event network-vif-deleted:7ca48e17-28e4-419c-89e6-7f1b2d459420 for instance 76332b41-4b20-4056-a012-0ff87d99138c on hv-cinder-86236 Nov 02 20:52:09.209657 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [req-c667b3a6-3127-46e8-ba1a-f0b7fffbc46c req-ae6ecdc0-e7e4-4868-b3ee-b7fc80778699 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098416 Nov 02 20:52:09.210225 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 607/1218] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 20:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 20:52:10.213042 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '>' {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:52:10.213646 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.compute.api [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] [instance: 76332b41-4b20-4056-a012-0ff87d99138c] Fetching instance by UUID {{(pid=118986) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 20:52:10.219951 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:10.220424 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:10.220851 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:10.221527 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Acquiring lock "a1c810e1-7ff3-414d-8672-1a44e300f691" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 20:52:10.221971 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 20:52:10.222385 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG oslo_concurrency.lockutils [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Lock "a1c810e1-7ff3-414d-8672-1a44e300f691" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 20:52:10.235481 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.wsgi [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] HTTP exception thrown: Instance 76332b41-4b20-4056-a012-0ff87d99138c could not be found. Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Request method failure captured: Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: request: GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c HTTP/1.1 Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept: application/json Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Accept-Encoding: identity Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Connection: close Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Length: 0 Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Content-Type: application/json Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Host: 10.222.0.26 Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: Openstack-System-Scope: None Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: User-Agent: python-urllib3/1.26.12 Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Auth-Token: gAAAAABjYtc6sG9Gt6d-oTlrRJwcAM8xGWhK38Wr7nQ-WdLw0Ayo7mfj3GbRb6wEZ2Jf_1vOTSn7MWKOJDJB-jqzaaYmmdHL-lUGutGKWuOvhiUEK419qDHqGjaU6qH8mNVVA7t5Tm5U5nUPkkbs6VtqJutpyaBmbqdwKRC07VVZD-lfl2Z6d1c Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Id: None Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Domain-Name: None Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Identity-Status: Confirmed Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Is-Admin-Project: True Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Id: default Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Domain-Name: Default Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Id: 05738aea94f0499a99582c6458880dbd Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Project-Name: tempest-TestShelveInstance-1865217196 Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Role: reader,member Nov 02 20:52:10.237182 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Roles: reader,member Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05738aea94f0499a99582c6458880dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05738aea94f0499a99582c6458880dbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05738aea94f0499a99582c6458880dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05738aea94f0499a99582c6458880dbd"}]}] Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant: tempest-TestShelveInstance-1865217196 Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Id: 05738aea94f0499a99582c6458880dbd Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-Tenant-Name: tempest-TestShelveInstance-1865217196 Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User: tempest-TestShelveInstance-1865217196-project Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Id: default Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Domain-Name: Default Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Id: 4955b7580d544cfb91c44b8d4c6758dd Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: X-User-Name: tempest-TestShelveInstance-1865217196-project Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: method: > Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: exception: Instance 76332b41-4b20-4056-a012-0ff87d99138c could not be found. Nov 02 20:52:10.239092 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: action_args: {'id': '76332b41-4b20-4056-a012-0ff87d99138c'} Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: {{(pid=118986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76332b41-4b20-4056-a012-0ff87d99138c could not be found. Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 20:52:10.240285 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76332b41-4b20-4056-a012-0ff87d99138c could not be found. Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76332b41-4b20-4056-a012-0ff87d99138c could not be found. Nov 02 20:52:10.242000 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: ERROR nova.api.openstack.wsgi Nov 02 20:52:10.244106 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: DEBUG nova.api.openstack.wsgi [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Returning 404 to user: Instance 76332b41-4b20-4056-a012-0ff87d99138c could not be found. {{(pid=118986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 20:52:10.244106 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: INFO nova.api.openstack.requestlog [None req-fd34856e-2b68-4cc4-9602-6db64d449069 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c" status: 404 len: 111 microversion: 2.1 time: 0.029940 Nov 02 20:52:10.244106 dv-cinder-862365-5-iscsi devstack@n-api.service[118986]: [pid: 118986|app: 0|req: 612/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 20:52:10 2022] GET /compute/v2.1/servers/76332b41-4b20-4056-a012-0ff87d99138c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 20:52:10.397381 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: DEBUG nova.api.openstack.wsgi [None req-d8bb478b-b1ce-44a2-969b-2facc1bcec67 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] Calling method '.version_select at 0x7f2e222a7ee0>' {{(pid=118985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 20:52:10.423036 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: INFO nova.api.openstack.requestlog [None req-d8bb478b-b1ce-44a2-969b-2facc1bcec67 tempest-TestShelveInstance-1865217196 tempest-TestShelveInstance-1865217196-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-958206346" status: 202 len: 0 microversion: 2.1 time: 0.030464 Nov 02 20:52:10.423785 dv-cinder-862365-5-iscsi devstack@n-api.service[118985]: [pid: 118985|app: 0|req: 608/1220] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 20:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-958206346 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)